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EXECUTIVE SUMMARY 


The Continuing Survey of Food Intakes by Individuals and the Diet and Health 
Knowledge Survey (CSFII/DHKS) 1994-96 are being conducted by Westat, Inc., under contract to the 
Agricultural Research Service, U.S. Department of Agriculture (ARS, USDA).! Westat, Inc., was 
awarded the contract at the end of September 1992. A 1-year period beginning at contract award was 
devoted to the design, conduct, and evaluation of a Pilot Study as a dress rehearsal for the 3-year Main 
Survey. The Pilot Study allowed for the testing and evaluation of all survey procedures and materials, 
including sampling procedures, the training of the field staff, the ability to achieve high response rates, 
the data collection instruments, and the data processing activities. From October 1992 through 
September 1993, staff from Westat and ARS worked collaboratively on the Pilot Study in preparation 
for the Main Survey. Three years of continuous Main Survey data collection began in January 1994. 


During the 3 years of data collection, interviewers conduct two 24-hour food Intake 
interviews (spaced 3 to 10 days apart) with approximately 15,000 sample persons (SPs). In households 
with eligible SPs, interviewers also administer a Household Questionnaire, which collects 
Socioeconomic data about the household, and a Diet and Health Knowledge Survey (DHKS) 
Questionnaire to capture the selected SP's knowledge, attitudes, and behaviors on diet and health 
issues. This report documents the procedures and accomplishments of the CSFII/DHKS 1994, the first 
of the 3 survey years. 


A multistage area probability sample design was used to select persons for the Intake and 
DHKS interviews. The design included the selection of (1) 62 primary sampling units (PSUs), which 
are metropolitan statistical areas or groups of counties; (2) area segments within the sampled PSUs; (3) 
households within the selected segments; and (4) SPs within households. 


For the CSFII/DHKS 1994, Westat recruited and trained a field organization of 5 regional 
supervisors, 5 senior interviewers, and 90 interviewers (10 of whom were bilingual). The field staff 
attended 7 days of in-person training, which was monitored by ARS, on the use of all questionnaires, 
materials, and procedures. The supervisors and senior interviewers received an additional day of 
training that detailed their management responsibilities. To enable close supervision of data collection, 
Westat developed an automated Field Management System (FMS) that operated on laptop computers 
provided to the supervisors and interviewers. The FMS captured and reported interviewing production 
and cost data on a weekly basis. Quality control of interviewing was conducted throughout the year 
and included taped interviews, in-field observations of the interviewers at work, and validation 
interviews of a portion of each interviewer's work to confirm that the interviews had been conducted. 


The interviewing for the CSFII/DHKS 1994 involved screening 8,333 occupied 
households for basic demographic information about household members, for a Screener response rate 


1 Some of the work described in this report was performed under the direction of the Human Nutrition Information Service, USDA. 
Legislation passed on February 20, 1994, transferred the functions and staff of this agency to the existing Agricultural Research Service of 
that department. 


2 The contract for the CSFI/DHKS 1994-96 contains very specific requirements for sample precision and sample yields, data collection 
schedule and contact procedures, response rate targets, quality control procedures, data processing and delivery schedule and quality 
specifications, reporting schedule, and 20 contract deliverables. The efforts described in this report are in response to these requirements. 


Xili 


of 98.4 percent. Of the screened households, 3,264 households had a total of 6,864 SPs eligible for 
the Intake interview. Interviewers were able to complete Day 1 and Day 2 Intake interviews with 
5,311 SPs, for an interview response rate of 77.4 percent. Additionally, 2,813 Household 
Questionnaires and 1,879 DHKS Questionnaires were completed, for response rates of 86.2 percent 
and 91.8 percent, respectively. The target response rates specified in the contract were exceeded for 
each of the survey's instruments. 


In preparation for coding the Intake Questionnaires, 14 food coders were trained and 
certified. The coding of food items on the Intake Questionnaires was accomplished using Survey Net, 
a computer-assisted food coding system designed for the CSFII and provided to Westat by ARS. Four 
coders were trained to code and edit the non-Intake documents. The non-Intake documents were 
manually coded, keyed, and machine edited. The processed questionnaire data were delivered 
electronically to ARS once a week. Interviewers and coders received feedback on the results of the 
quality review performed at Westat and ARS. 


Westat's Forms Tracking System (FTS) was used to track survey documents from receipt 
at the home office through delivery to ARS. A "snapshot" of FTS data was transmitted electronically 
to ARS every day. The FTS also generated reports on the status of data processing and the quality of 
Survey Net coding. 


Two sets of sampling weights were calculated for the CSFII/DHKS 1994, one for the Day 


1 Intake interviews and the other for the DHKS interviews. Jackknife replicate weights were also 
calculated to facilitate variance estimation. 
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1. INTRODUCTION 


At the end of September 1992, Westat, Inc., was awarded a contract to conduct the 
Continuing Survey of Food Intakes by Individuals and the Diet and Health Knowledge Survey 
(CSFII/DHKS) 1994-96. The 1994-96 survey will be the third in a series of U.S. Department of 
Agriculture surveys responsive to the National Nutrition Monitoring and Related Research Program 
requirements for the continuous collection, processing, and analysis of dietary status data of the U.S. 
population. The 1994-96 survey is the first to be conducted by Westat, Inc. The 1994-96 survey 1s 
being administered by the Agricultural Research Service (ARS), USDA.’ 


The CSFI/DHKS 1994-96 contract was set up with an initial 1-year period, beginning at 
the time of contract award, for the design, conduct, and evaluation of a Pilot Study as a dress rehearsal 
for the Main Survey. Specifically, the Pilot Study was an opportunity to test all of the survey 
operations, procedures, and materials associated with the study's design. From October 1992 through 
February 1993, staff from Westat and ARS worked collaboratively in preparing for the Pilot Study. 
During this period, the study questionnaires were finalized and a Food Instruction Booklet (FIB) 
containing detailed probes for the interviewers to use during the Intake interview was extensively 
revised. Instructional manuals and training programs were developed for field supervisors, 
interviewers, and coders. Considerable effort was also spent on developing a set of materials that 


interviewers could use with respondents to gain their participation in the Pilot Study. 


The Pilot Study was a very valuable experience for Westat and ARS. Survey 
participation and response rates were positive, and interviewers and coders were trained to collect and 
process high-quality data. The automated management systems developed to monitor the data 
collection and data processing activities, the Field Management System and the Forms Tracking 
System, provided timely information that was very useful for performing the work. The Survey Net 
system developed to code the food data was highly regarded by the data processing staff who used it. 
A report submitted to ARS at the conclusion of the Pilot Study outlined results and included 


recommendations for the Main Survey. 


' Some of the work described in this report was performed under the direction of the Human Nutrition Information Service, USDA. 
Legislation passed on February 20, 1994, transferred the functions and staff of this agency to the existing Agricultural Research Service of 
that department. 
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The Main Survey was intended to span 3 years of data collection beginning in January 
1994, with each year a separate contractual option. As a result of the experience from the Pilot Study, 
staff from Westat and ARS worked collaboratively to revise the survey instruments and other materials 
for the Main Survey. Questionnaires were refined and the FIB was expanded and improved. The 
instructional manuals and training programs for field supervisors, interviewers, and coders were also 
revised to reflect lessons learned from the Pilot Study. This report covers the first of the 3 years of 
data collection for the Main Survey, referred to as the CSFII/DHKS 1994.” 


The design of the CSFII/DHKS 1994-96 requires that a sample of persons (referred to as 
SPs) participate in two 24-hour food Intake interviews spaced 3 to 10 days apart. To identify the SPs, 
interviewers carry out a screening procedure with a sample of dwelling units (DUs) to determine a 
specified number of SPs in accordance with the sample design requirements in the contract. Two 
additional questionnaires are completed at households with eligible SPs: A Household Questionnaire 
collecting socioeconomic data administered in person to a knowledgeable household respondent and a 
DHKS Questionnaire completed primarily by telephone with a selected SP 2 to 3 weeks after the 


second Intake interview. 


The CSFI/DHKS is a multistage area probability sample design consisting of 62 primary 
sampling units (PSUs). These PSUs are metropolitan statistical areas or groups of counties selected 
with probabilities proportional to the 1990 population. Data collection occurs in all 62 PSUs during 


each year of the survey. 


In each PSU, 36 second-stage sampling units (i.e., area segments consisting of Census 
blocks or block groups) were selected before the start of Main Survey data collection in J anuary 1994. 
Within each PSU, one-third of the sampled segments were randomly assigned to each of the 3 years of 
the survey, and within each year, one-quarter of the segments were randomly assigned to each quarter 
of the year. Lists of addresses of every DU within each area segment were compiled. From the lists 
of DUs, a self-weighting sample of approximately 9,500 DUs was selected for the CSFII/DHKS 1994. 
To enable interviewers to systematically select SPs within sampled DUs, 1 of 24 sampling messages 
was assigned to each household. A description of the sample design can be found in Chapter 2 of this 
report. 


> The contract for the CSFIVDHKS 1994-96 contains very specific requirements for sample precision and sample yields, data collection 
schedule and contact procedures, response rate targets, quality control procedures, data processing and delivery schedule and quality 
specifications, reporting schedule and 20 contract deliverables. The efforts described in this report are in response to these requirements. 


To conduct the CSFII/DHKS 1994, a field organization of 5 regional supervisors, 5 
senior interviewers, and 90 interviewers was recruited and trained. The regional supervisors and 
senior interviewers attended an 8-day training session in mid-December 1993. The first 6 days of the 
Session were a dress rehearsal for interviewer training, while the last 2 days were devoted to 
supervisory responsibilities. Eighty-two interviewers were trained in a 7-day session held in early 
January 1994. An additional eight interviewers were hired and trained during 1994. At training, 
interviewers received instruction in the use of all questionnaires and procedures, with extensive hands- 
on practice with the instruments, the FIB, and the food measuring guides. As part of training, each 
trainee interviewed a respondent who was brought into the session. In addition, after leaving training 
and before beginning interviews, each interviewer had to complete a practice interview that was 
reviewed by his or her supervisor and a mock interview that was conducted by telephone with the 


supervisor. 


Based on the workload in the PSU, 26 of the PSUs were staffed with two interviewers 
and 36 PSUs were staffed with one interviewer. Each regional supervisor was responsible for 12 
PSUs and approximately 20 percent of the interviewing workforce. The supervisors were in direct 
communication with the interviewers and reported to the field director in Westat's home office. 
Supervisors assigned work to their interviewers and monitored production, costs, and the quality of 
each interviewer's work. Each supervisor was assisted by a senior interviewer, who was available to 


travel to convert nonresponse cases and observe the interviewers at work. 


As will be described in Chapter 3 of this report, the interviewing for the CSFII/DHKS 
1994 involved screening 8,333 of the 8,467 occupied households, representing a 98.4 percent Screener 
response rate. Of the screened households, 3,264 households had a total of 6,864 SPs eligible for the 
Day 1 Intake interview and 6,863 eligible for the Day 2 Intake. Interviewers were able to complete 
Day 1 and Day 2 Intake interviews with 5,311 SPs, for an interview response rate of 77.4 percent. 
Additionally, 2,813 Household Questionnaires and 1,879 DHKS Questionnaires were completed, for 


response rates of 86.2 percent and 91.8 percent, respectively.” 


> The numbers eligible do not include households or SPs who left the population of interest before having a chance to participate: two 
households, four SPs before completing the Day 1 Intake interview, five SPs before completing the Day 2 Intake interview, and two SPs 
selected for the DHKS. These ineligible households and SPs are not included in the denominator of the response rate calculations reported 
on page 3-32. For a discussion of the population of interest, see pages 6-1 and 6-2 of this report. 


Quality control of the interviewing process was conducted throughout the year. Regional 
supervisors reviewed practice interviews, listened to taped interviews, conducted in-field observations 
of the interviewers at work, and performed validation procedures to confirm that interviews had been 
conducted. In addition, an extensive quality review was completed when the questionnaires were 


receipted in the home office and interviewers received feedback on the results of this review. 


To enable close supervision of the data collection, Westat developed an automated Field 
Management System (FMS). The FMS captured and reported data on field production and costs. 
Field interviewers and supervisors operated the FMS software on laptop computers. Once a week, the 
interviewers transmitted field production and cost data to the home office that in turn was downloaded 


to the supervisors. Reports on response rates, production, and costs were generated weekly. 


The data processing of questionnaires, described in Chapter 4, began shortly after the 
Start of data collection. Materials and systems developed for the Pilot Study were revised to reflect 
changes to the questionnaires and Pilot Study experience. These materials and systems included 
programs for data entry and cleaning, instructional manuals for reviewing and coding Intake and non- 
Intake questionnaires (i.e., the Screener, the Household Questionnaire, and the DHKS Questionnaire), 


file layouts, and an automated Forms Tracking System to monitor the stages of data processing. 


Fourteen food coders were trained to code the Intake questionnaires. Training for the 
food coders began when they attended portions of the interviewer training, followed by 8 days of coder 
training. Coders had to successfully complete test sets of Intake questionnaires developed by ARS 
before they were certified to begin coding. Food coders were also trained to code the non-Intake 
questionnaires. In early May 1994, four additional coders were trained to process non-Intake 


questionnaires. 


When questionnaires arrived in the home office, they were first reviewed to be sure that 
the minimum set of data items was present to consider the questionnaire completed. The coding of 
food items reported on the Intake Questionnaires was accomplished using Survey Net, a computerized 
food coding system designed for use in the CSFII/DHKS 1994 and provided to Westat by ARS. ARS 
worked closely with Westat to modify Survey Net after the Pilot Study. Asa quality control measure, 
10 percent of Intake Questionnaires were double-coded using Survey Net and adjudication reports were 
produced. Discrepancies were resolved by Westat's coding supervisor. All coding decisions and 


questions were recorded in Survey Net for review by ARS. 
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The non-food questions on the Intake Questionnaire and the non-Intake documents 
underwent manual coding and data entry in Westat's production data entry shop, using the Tartan 
system of data entry hardware and software. As a quality control measure, 100 percent of the non- 
food data were independently double entered. Following key entry, the data were machine edited 
using programs developed with COED, Westat's software system for cleaning survey data. The 
COED software generated machine edit programs, which checked that all keyed data were within the 
acceptable ranges and that all skip patterns had been followed correctly. Uncodeable and out-of-range 
responses were recorded for review by ARS staff. Special programs were also written to check the 
relationships between Survey Net coversheet entries and the Tartan/COED data. The processed 


questionnaire data were delivered electronically to ARS once a week. 


Westat developed the Forms Tracking System (FTS) to manage receipt and processing 
activities performed at the home office. The system tracked a document from the time it arrived at the 
home office until it was delivered to ARS. Current FTS data were electronically transmitted to ARS 
every day. The FTS also generated weekly reports, which detailed the number of documents received, 
the number of documents at each stage of processing, and the status of the coder quality control 


operations. These reports were electronically transmitted to ARS weekly. 


Throughout the survey year, ARS was actively involved with Westat in the management 
of the survey. Westat submitted monthly progress reports and participated in quarterly progress 
meetings, as called for in the contract, to report on the status of the project. Meetings between Westat 
and ARS were held as needed to discuss issues, such as data processing, revisions to the FIB, and 
weighting of the survey data. The Westat project director and the ARS Project Officer held weekly 
telephone calls to discuss progress of the survey. In addition, Westat's director of data processing was 
in regular telephone contact with key ARS staff responsible for Survey Net coding and the quality of 
the Intake and non-Intake data. 


The CSFII/DHKS 1994 was successful in achieving many of its goals. The response 
rates specified in the contract for the various instruments were all exceeded. The number of completed 
dietary Intake interviews required for the first of the 3-year sample design plan met or exceeded the 
goal for most of the 40 sampling domain groups. Adjustments to sampling rates will be made over the 
3 years to try and achieve the target sample sizes for all domains. Westat's staff and approach to 
processing the data improved steadily over the year so that by the second half of the year, 


questionnaires were being reviewed within 2 days of receipt. The feedback received from ARS on the 


quality of the data delivered by Westat was instructive and positive. The staff, systems, and operating 
procedures developed for the CSFII/DHKS 1994, as well as Westat's collaborative working 
relationship with ARS, should provide a firm basis for the continuing work into the next year of the 


survey. 
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2. SAMPLE DESIGN 


The purpose of this chapter is to describe the sample design for the Continuing Survey of 
Food Intakes by Individuals and the Diet and Health Knowledge Survey (CSFII/DHKS) for 1994. 
However, the full CSFII/DHKS runs over the calendar years 1994 through 1996, and the overall 
sample design is constructed to satisfy objectives for the full survey. Thus, although the discussion 
below focuses mainly on the 1994 sample, the sample design for the full survey must be presented. 
Attachment 2.A contains selected procedural memos related to sampling for the CSFII/DHKS 1994-96. 


sag | Introduction and Overview 


The primary goal of the sample design for the CSFII/DHKS 1994-96 is to obtain 
nationally representative samples of noninstitutionalized persons residing in the United States for each 
of 40 analytic domains defined by sex, age (10 age groups), and income level (a "low-income" group 
and an “all-income" group) that are aimed to meet specified precision levels for estimates of mean Day 
1 saturated fat and iron intakes. Excluded are persons living in group quarters or institutions, residing 
on military installations, and the homeless. The specific precision levels were that (1) the coefficients 
of variation (CV) for mean saturated fat and iron intakes should be 3 percent or less for each of the 20 
all-income sex-age domains and (2) the corresponding CVs for the low-income sample should be 5 
percent or less for each sex-age domain (Section IV.1 of the Statement of Work). These precision 
goals translate to the 3-year target sample sizes summarized in Table 2-1. In addition, the 
CSFII/DHKS design specifies that one Day 1 Intake respondent (20 years of age or older) be selected 
for the DHKS from each household with at least one Day 1 Intake respondent aged 20 or over. It 
should be noted that for the CSFII/DHKS 1994-96, a single sample was designed with precision 
requirements by income level. In the past, a separate sample of low-income persons was also designed 


and selected, in addition to the basic general sample (see Section I.B of the Statement of Work). 


A complex multistage area probability sample design was used to select persons for the 
Intake and DHKS interviews. The design was a stratified multistage area probability sample that 
included the selection of geographical areas called primary sampling units (PSUs), area segments 
within the sampled PSUs, households within the selected segments, and sample persons (SPs) within 


the households. The major features of the sample design are summarized below: 
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Table 2-1. Three-year sample size goals for the CSFII/DHKS 1994-96 


Income group 


Age group All income 
(years) Low income* (total sample) 


15,482 


*Households with incomes below 130 percent of Federal poverty guidelines. 


The first-stage sample was a stratified sample of 62 PSUs consisting of 
metropolitan statistical areas (MSAs) or groups of counties. PSUs were selected 
within strata of approximately equal size, with probabilities proportional to the 
1990 population. 


Thirty-six area segments (consisting of Census blocks or groups of blocks) were 
selected from each PSU, for a total of 2,232 area Segments for the 3-year survey. 
The 36 segments selected from each PSU were then divided into 12 sets of 3 
segments each, and a set of 3 segments per PSU was assigned to each of the 12 
quarters of the 3-year survey period. 


Within the sampled segments, lists of dwelling units (DUs) are prepared by Westat 
interviewers. More than 108,000 DUs were listed for the first year of the study. 
From the lists of DUs, a self-weighting sample of approximately 9,500 DUs was 
selected for the CSFII/DHKS 1994. 


a Within the occupied DUs identified during screening, persons eligible for the 
survey were selected by a probability sampling process designed to achieve the 
specified sample sizes for various sex-age-income domains (see Table 2-1). 


= Finally, in households containing SPs 20 years of age or older who completed the 
Day 1 Intake interview, one was randomly selected for the DHKS. 


Additional details about the CSFII/DHKS sample design and selection procedures are 
given in Sections 2.2 through 2.6. Section 2.2 describes the procedures used to select the sample of 
PSUs. Section 2.3 describes the selection of area segments within PSUs (including the use of an 
existing sample of previously listed segments to reduce costs), and Section 2.4 discusses the 
procedures for selecting DUs within the sampled segments. Finally, Sections 2.5 and 2.6 describe the 


procedures for selecting household members for the Intake and DHKS interviews. 


2.2 Selection of Primary Sampling Units 


The sampling frame of PSUs was created from county-level data contained in the 1990 
Census Public Law 94-171 (PL 94) and the Bureau of Economic Analysis data files. The PL 94 data 
file provided county-level population counts by race and Hispanic origin, while the Bureau of 
Economic Analysis file provided the corresponding income information. In general, PSUs were 
defined to be MSAs or groups of contiguous counties. Because of their large populations, the New 
York MSA was divided into three PSUs and the Los Angeles and Chicago MSAs were each divided 
into two PSUs. Each of the remaining MSAs comprised a single PSU. Counties outside of MSAs 
were grouped, as necessary, to form PSUs that (1) had a minimum 1990 population of 15,000 persons, 
(2) were as internally heterogeneous as possible, and (3) were still small enough to permit convenient 
travel across the PSU by interviewers. From the more than 3,000 counties in the United States, 1,404 
PSUs were created. 


The 24 largest PSUs in the frame were included in the sample with certainty. The 
remaining (noncertainty) PSUs were then assigned to 1 of 38 strata of approximately equal size (in 
terms of 1990 population), and one PSU was selected per stratum with probability proportional to 1990 
population. The following stratification variables were used (some explicitly and some implicitly) to 


select the noncertainty PSUs: 
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i) Region of the country (four Census regions); 


= Whether or not the PSU is an MSA (among the noncertainty strata, 26 were MSA 
strata and 12 were non-MSA strata); 


fs Population of the MSA; 
8 Percent of the population in the PSU who are black or Hispanic; and 


= Per-capita income. 


The definitions of the 38 noncertainty strata are documented in Table 2-2A, and the 
distribution of the sampled PSUs by Census region and MSA status is summarized in Table 2-2B. 
Finally, the locations of the 62 sampled PSUs are shown in Exhibit 2-1 to provide an indication of the 
geographic spread of the PSU sample. Attachment 2.B provides a list of the sampled PSUs along with 
selected characteristics of the PSUs. 


2.3 Selection of Area Segments 


The second-stage sampling units were area segments, which were defined to be individual 
Census blocks or a group of blocks. A sample of 36 area segments was randomly selected from each 
PSU with probabilities proportional to size. The 36 segments selected from each PSU were then 
divided into 12 sets of 3 segments each, and a set of 3 segments per PSU was assigned to each of the 
12 quarters of the 3-year survey period. As described below, segments were assigned to the quarters 
of the year in a balanced random manner to ensure a wide spread of the segment sample within each 
quarter for each PSU. This balanced sampling was carried out in order to improve sampling precision 


by reducing the design effects resulting from the homogeneity of persons within segments. 


The first step in the sampling process was to create a frame of area segments for each of 
the 62 sample PSUs. This frame was constructed from the Census Bureau’s 1990 PL 94 data tape, 
which contains population, housing counts, and limited geographic information for each block in the 
United States. To ensure that the segments would be of sufficient size for use in sampling, small 
blocks were combined with adjacent blocks to form segments that had a minimum expected size of 60 
DUs. After the frame had been constructed, the area segments were sorted into minority strata 


(depending on the proportion of black and Hispanic persons in the segment) and geographically within 
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Northeast 
Northeast 
Northeast 
Northeast 
Northeast 
Northeast 
Northeast 


Midwest 
Midwest 
Midwest 
Midwest 
Midwest 
Midwest 
Midwest 
Midwest 
Midwest 
Midwest 


South 
South 
South 
South 
South 
South 
South 


South 


South 
South 
South 
South 
South 
South 


West 
West 
West 
West 
West 
West 


West 


Metropolitan 


status 


Non-MSA 
MSA 
MSA 
MSA 
MSA 
MSA 
MSA 


Non-MSA 
Non-MSA 
Non-MSA 
Non-MSA 
MSA 
MSA 
MSA 
MSA 
MSA 
MSA 


Non-MSA 
Non-MSA 
Non-MSA 
Non-MSA 
Non-MSA 
MSA 

MSA 


MSA 


MSA 
MSA 
MSA 
MSA 
MSA 
MSA 


Non-MSA 
Non-MSA 
MSA 
MSA 
MSA 
MSA 


MSA 


1990 PSU 
population 
size class 


1,300,000 + 
500 ,000- 
1,299,999 
< 500,000 


Table 2-2A. Definition of noncertainty PSU strata for the CSFII/DHKS 


Income or minority status 


All PSUs 

$23,053 or more per-capita income 
Less than $23,053 per-capita income 
$19,275 or more per-capita income 
$17,280-19,052 per-capita income 
$15,993-17,192 per-capita income 
$12,280-15,927 per-capita income 


$14,123 or more per-capita income 
$13,291-14,121 per-capita income 
$12,188-13,272 per-capita income 
$7,096-12,174 per-capita income 
$17,156 or more per-capita income 
Less than $17,156 per-capita income 
$16,475 or more per-capita income 
$15,713-16,466 per-capita income 
$14,418-15,647 per-capita income 
$10, 185-14,389 per-capita income 


33 percent or more black persons 
20-32.8 percent black persons 
$12,696 or more per-capita income 
$11,190-12,612 per-capita income 
$6,115-11,167 per-capita income 
31.6 percent or more black persons 


Less than 31.6 percent black persons, and 


$14,744 or more per-capita income 


Less than 31.6 percent black persons, and 


less than $14,744 per-capita income 
14.5 percent or more Hispanic persons 
$16,399 or more per-capita income 
Less than $16,399 per-capita income 
$15,432 or more per-capita income 
$14,059-15,068 per-capita income 
$11,262-14,017 per-capita income 


$12,885 or more per-capita income 
Less than $12,885 per-capita income 
26.3 percent or more Hispanic persons 
13.2-24.3 percent Hispanic persons 
$17,057-19,667 per-capita income 
$13,087-17,540 per-capita income 


$9,993-21,840 per-capita income 


Table 2-2B. Distribution of 62 CSFII/DHKS PSUs by Census region and MSA status 


| Pale ae Ree St ee of PSU 


Certainty | Noncertainty 
MSA MSA Non-MSA 


Census region 


Northeast 
Midwest 17 
South 18 


West 


minority strata before sample selection. For each of the 3 years of the study, a systematic sample of 
12 area segments was selected from the sorted frame with probabilities proportional to the number of 


DUs in the segment. 


To reduce sampling costs, advantage was taken of a national sample of segments that 
Westat had previously selected and listed in the selected PSUs. The sample developed for the National 
Adult Literacy Survey (NALS) used basically the same sampling procedures required for the 
CSFII/DHKS, except that high-density minority segments were selected at about twice the rate of the 
nonminority segments. For the NALS, the segments were deliberately made much larger than needed 
(they were designed to contain a minimum of 60 DUs) so that they could serve as the equivalent of a 
master segment sample that could be used for other studies. Fifty-six percent of the 2,232 segments 
required for the CSFII/DHKS sample could be drawn from the previously selected NALS segments. 
The remaining segments were selected in a way that yielded the desired overall probabilities of 
selection while maximizing the overlap with the NALS sample (see Section 2.3.1). Use of the master 
segment sample reduced the cost of sampling, mapping, and listing by about 40 percent. It should be 
noted that although the listings from the master sample were about 2 years old when the first year of 
the CSFII/DHKS was conducted, the listings were updated through standard quality control procedures 
(see Section 2.4.4). 
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Exhibit 2-1. Sample of 62 primary sampling units by Census region for the CSFII 1994-96 


Type of PSU 


Cora Certainty MSA 


Noncertainty MSA 
Non- MSA 


2.3.1 Procedures to Maximize Overlap with the National Adult Literacy Survey Sample 


The following procedure was used to select the segment sample. It can be shown that the 
procedure produces a segment sample with the desired probabilities of selection for the CSFII/DHKS, 


while maximizing the overlap with the previous NALS sample.! 


For a given PSU, let p; denote the (within-PSU) probability of selecting the 
i-th segment for NALS, and let P; denote the corresponding desired probability of selecting the 
segment for the CSFII/DHKS. Specifically, 


: ; MNALs 
I I; 
and 
MCSFI 
P, * 36M; 
ted 
where 
NALS : 
M; = the NALS measure of size for segment i; 
I; os the sampling interval used to select the NALS segment sample 
within PSU 1; 
yee al the number of DUs in segment i2; and 
N 
>) Magus = the total CSFIJ/DHKS measure of size for the PSU. 
i=1 


NALS 
The NALS measure of size, M; , was a weighted sum of the within-segment 


population counts for minority and nonminority groups that was designed to give the high-density 


1 Brick, M., Morganstein, D., and Wolters, C. (1987). Additional uses for Keyfitz selection. Proceedings of the Section on Survey 
Research Methods of the American Statistical Association, pp. 787-791. 


2 some blocks are recorded in the Census files as having 0 DUs. All such blocks were retained in the sampling frame and given a minimum 


sampling measure of size of 60. This was done to avoid excluding blocks containing newly constructed DUs that were not reflected in the 
Census file counts. 


2-8 


minority segments a relatively higher probability of selection than the nonminority segments. Because 
there was no requirement to "oversample" high-density minority segments for the CSFII/DHKS, the 
procedure described below had the effect of adjusting for the higher-than-desired selection probabilities 


of these segments. 


Within a PSU, the "frame" of area segments was divided into the four classes listed in 
Table 2-3. The appropriate "conditional selection probability" defined in the last column of Table 2-3 
was then assigned to each segment in the frame. For example, if a segment was previously selected for 
the NALS sample and P. > p, (class A), then this segment was assigned a conditional selection 
probability of 1 and was retained in the CSFII/DHKS sample with conditional certainty. On the other 
hand, segments in class D (i.e., non-NALS segments with a smaller CSFII/DHKS probability than 
NALS probability) were assigned a conditional probability of 0 and thus had no chance of being 
selected for the CSFII/DHKS (although they did have an appropriate chance of selection in the original 
NALS sampling process). 


Let a be the number of segments in class A (i.e., NALS segments to be retained for the 
CSFII/DHKS). With a required 36 segments per PSU for the CSFI/DHKS, an additional (36-a) 
segments were selected from classes B and C with probabilities proportional to the conditional 
selection probability. Before selection, the file of segments was sorted to reflect the implicit 
Stratification used in the NALS sample selection. Of the 2,232 segments selected for the 
CSFII/DHKS, 1,254 were NALS segments. 


Table 2-3. Definition of segment classes used to select CSFII/DHKS segments and corresponding 
probabilities of retention 


Segments in the NALS sample for which P; > P; 


Conditional (on NALS status) 
selection probability 


i 


B Segments in the NALS sample for which P; < P; Pilp, 
Cc Non-NALS segments for which P; > P; (P;- py - P,) 
D Non-NALS segments for which P; < P; 0 
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PSB IA Assignment of Segments to Years and Quarters 


After the segments had been selected, they were numbered sequentially from 1 to 36 
within each PSU to reflect the original NALS selection order. Table 2-4 was then used to assign the 
segments from each PSU to 1 of 12 "segment groups." A random permutation of the integers 1, 2, and 
3 (denoted by A, B, and C) and another random permutation of the integers 1, 2, 3, and 4 (denoted by 
Q, R, S, and T) were generated separately for each of the 62 sample PSUs. The 12 segment groups 
were then assigned to 1 of the 3 survey years A, B, or C and to quarters Q, R, S, and T, as indicated 
in Table 2-4. The use of the 12 segment groups defined in Table 2-4 was intended to balance the 


spread of the sampled segments for each year across the sorted frame of segments. 


Table 2-4. Assignment of ordered segments to segment groups, years, 
and quarters 


Ordered CSFI/DHKS 
segment number in PSU Year 
25 24 A 


Segment 
group 


0 OXIARD NH PFW NY 
OW FeO tWD > OF -& G Ww 
SxHoxuH nnnwenwry wry RH AHL 
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2.4 Selection of Dwelling Units 


The following sections describe the procedures used to select the sample of DUs for the 
first year of the survey. These sections summarize the procedures used to create the segment-level lists 
(frames) of DUs (Section 2.4.1), special procedures for handling a few extremely large segments in the 
listing process (Section 2.4.2), the selection of DUs from the segment listings (Section 2.4.3), and the 
field procedures used to verify and update the listing information (Section 2.4.4). Finally, Section 


2.4.5 summarizes the results of the DU sampling process. 


2.4.1 Listing Procedures 


The purpose of listing was to create a list of DUs from which a sample could be selected 
for interviewing. For the sample to be representative of the population of interest, it was essential that 
the listing be carried out accurately and systematically, so that every DU in a designated segment was 
included in the list. The process of listing involved an interviewer walking or driving through every 
Street, road, alley, and/or boundary in the segment and recording on listing forms the address and/or 
description of every DU within the boundaries of the selected segments (for a complete description of 


listing procedures, see Westat's Listing Manual). 


Map Production 


The maps necessary to list the 978 non-NALS segments were generated in August 1993 
using the U.S. Census Bureau’s map-producing database called TIGER. The TIGER (T opologically 
Integrated Geographic Encoding and Referencing) file is a geographic database in which all map 
features are digitized and stored along with attribute information. TIGER files, available on CD- 
ROM, can be read into various Geographic Information Systems software packages for the PC. Using 
this database, the software can draw a map of any specified area, at any scale and level of detail. The 
files include all roads and many other terrain features such as railroads and water (rivers, streams, 
lakes, etc.). For each selected non-NALS segment, a detailed map and a “context” map were 
generated (these maps had already been produced for the NALS segments). The maps clearly showed 
the segment’s boundaries, the streets within the boundaries, and enough “context” so that interviewers 
could locate the segments within the general vicinity. For the first year of the study, maps were 
generated for 328 non-NALS segments in 59 of the 62 CSFII/DHKS PSUs. In three of the PSUs, no 
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new (non-NALS) segments were selected for the CSFII/DHKS 1994. The maps for the 650 segments 
selected for subsequent years of the CSFII/DHKS were stored in Westat's mapping department for use 
in the listing operations that would precede the 1995 and 1996 surveys. 


2.4.2 Use of Chunking to Reduce Listing in Large Segments 


Census data indicated that some of the sampled segments were very large. To reduce the 
listing workload in the large segments, an additional stage of sampling was introduced. In general, 
these segments (defined as segments with an estimated 500 or more DUs) were divided into two or 
more smaller "chunks" of approximately equal size, and one chunk was selected for listing with 
probability proportional to estimated size. Of the 744 segments selected for the first year of the 
CSFI/DHKS, 54 (including NALS segments) were chunked using these procedures. Although the 
selected chunks were treated like all other segments in the subsequent stages of selection, their 


probabilities of selection were properly adjusted to reflect the additional stage of selection. 


The following procedure was used to chunk the large segments. First, the lister 
canvassed the segment to obtain a quick and approximate count of DUs. Using these approximate 
counts of DUs, the segment was divided into two or more compact chunks of approximately the same 
size. From these, one chunk was randomly selected for listing with probability proportional to 


estimated size. 


2.4.3 Selection of Dwelling Units from Listed Segments 


A sample of approximately 9,500 DUs? was selected from the 744 segments (or chunks) 
designated for the first year of data collection. To select the sample, the overall national sampling rate 


was computed as follows: 


3 it was previously estimated that about 11,000 DUs would have to be selected for the CSFII/DHKS 1994. However, this estimate was 
subsequently reduced to 9,500 based on an analysis of current CPS data (see Project Memo #139 in Attachment 2.A). 
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where Nis the estimated number of DUs in the United States based on the DU counts obtained during 
listing. Specifically, N was calculated from this formula: 

L 
62 12 
- 1 N,, 
N=> (4) »S a (1) 
h=1 h’ j= hj 


: ok : Ley. 3 
where P, is the probability of selecting PSU h, Nj; is the number of DUs listed in segment j in PSU 
h, and P}, is the within-PSU probability of selecting segment j in PSU + for the first year of the study. 


For the NALS segments, the Ny ’s reflected the numbers of DUs originally listed for the 
NALS (i.e., not including any new or missed structures added through the "missed structure" or 
"missed DU" procedures described in Section 2.4.4). Ideally, these numbers should include new 
construction. However, the consequences of failing to do so are minor and do not result in any 
selection bias. As documented below, the within-segment sampling rates used to select the DUs were 
designed to produce a self-weighting national sample of approximately 9,500 DUs. Note that the 
procedure for selecting DUs within the NALS and non-NALS segments was slightly different because 
of the desire to avoid selecting those DUs previously selected for NALS in the NALS segments. 


Selection of Dwelling Units in Non-NALS Segments 


L . 
Let N,; denote the number of DUs that were listed in (non-NALS) segment j in PSU h. 
L eqeie 
The N;,; DUs in the segment were then subsampled with equal probabilities at a rate of 


(w) f 
Sj = Seer (2) 
? P,P yj 


where P,, is the probability of selecting the PSU and P}; is the conditional probability of selecting the 
: Cae : 
segment within the PSU. The within-segment sampling rate, Jnj >» Siven by formula (2) was designed 
Bi d . (w) 
to give each DU in the segment an overall probability of selection equal to f (i-e., LR hee ad 


The actual selection of DUs within a segment was accomplished by first creating a file of unique line 


numbers corresponding to the DUs listed in the segment, and then selecting the line numbers 


systematically using a random start and skip interval equal to 1/ ine . The systematic sampling 


algorithm described in Hansen, et al. (1953) was used to make the selections.4 


Selection of Dwelling Units in NALS Segments 


fh : i 
Let Nj; denote the number of DUs that were originally listed for the NALS in segment j 


in PSU h. For the NALS segments, the count Nii does not include any structures or DUs that were 
L 
added as a result of the missed structure or missed DU procedures (see Section 2.4.4). Of the N,, 
NALS 
DUs in the segment that were originally listed for the NALS, the n,, DUs that were sampled for 
NALS 


i 
the NALS were identified and excluded from the sampling process. The remaining N,; — nj); DUs 


were then subsampled at a rate of 


(w) 
iy aS as (3) 
-—Ny- 
le Pj hj a 
hj 


L NALS ji 
where the term (N,;-—n,; )/N,,; in the denominator of formula (3) is the probability that a DU in 


the segment was not previously selected for the NALS. 


The selection of DUs within a NALS segment was accomplished by first creating a file of 
unique line numbers corresponding to the DUs listed in the segment, deleting the line numbers 
corresponding to the DUs previously selected for NALS, and then selecting the line numbers 
systematically using a random start and skip interval equal to 1/ pee The overall sampling rate for 


DUs in the NALS segments is the same as that in the non-NALS segments (.e., 
Mey) L (w) ‘ 


L 
PEN —1y Ny Jn =J). 


a Hansen, M., Hurwitz, W., and Madow, W. (1953). Sample Survey Methods and Theory, Volume I (p. 343). New York: John Wiley & 
Sons. 
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2.4.4 Application of Missed Structure and Missed Dwelling Unit Procedures 


Two separate quality control procedures were used to check and update the listing 
information for all of the segments selected for the CSFII/DHKS 1994. Both of these procedures were 
conducted during data collection. The first of these, referred to as the missed structure procedure, was 
applied whenever the first DU in the segment was selected for the CSFII/DHKS sample. When a 
segment was designated for the missed structure procedure, the interviewer recanvassed the entire 
segment, and all DUs not previously listed were added to the sample (except as noted below). Because 
the probability of selecting the first DU in a Segment was equal to the within-segment sampling rate, 
all of the added DUs were selected at the same overall rate (i.e., they had the same overall probability 


of selection) as the rest of the sample. 


The above rule for designating the missed structure procedure segments applied to both 
the NALS and non-NALS segments. Because DUs selected for the NALS were excluded from the 
CSFII/DHKS sample, NALS segments that were designated for the missed structure procedure in the 
NALS were not designated for this procedure in the CSFII/DHKS. In effect, the updating work 
performed for the NALS was ignored for the CSFII/DHKS. However, no bias is introduced because 
the new or missed DUs still had their appropriate chances of selection for the CSFII/DHKS. 


The second procedure, referred to as the missed DU procedure, applied to structures 
containing many DUs (e.g., apartment buildings) and all DUs listed at a single address. If the first 
DU in the given structure was selected for the CSFII/DHKS sample, then the entire structure was 
checked to identify DUs that may have been omitted from the listing sheets. Any missed DUs found 


by this process were added to the sample. 


To keep the interviewing workload to manageable levels within the segment, upper limits 
were established for the number of missed or new DUs that would be added to the sample. These 
limits were 10 per segment for the missed structure procedure and 4 per structure for the missed DU 
procedure. Where the actual numbers of missed DUs exceeded these limits, a subsample of the missed 
DUs was retained in the sample. In the first year of the CSFII/DHKS, subsampling was required for 
only 4 of the 93 segments in which the missed structure procedure was applied. Subsampling of the 
missed DUs was not required for any structures in which the missed DU procedure was applied. 
During the first year of the study, 77 DUs were added to the sample through the missed DU procedure 
and 128 DUs were added through the missed structure procedure. 


2.4.5 Results of the Dwelling Unit Sampling Process 


As described previously, the goal in sampling was to select a self-weighting sample of 
approximately 9,500 DUs for the first year of the study. Because of a few coding errors in the listing 
worksheets, the actual number of sampled DUs was 9,423. In addition, 205 DUs were added in the 
field as a result of the missed structure or missed DU procedure; thus, the total number of DUs 
selected for the first year of the study was 9,628. Of these, 9,494 (99%) completed either the full or 
an abbreviated Screener Questionnaire (see Section 3.2 for additional details about the screening 
process). Almost 1,200 (12%) of the screened DUs were vacant or non-DU structures. Of the 8,333 
occupied DUs, 3,266 DUs (39%) had household members who were eligible for the survey (i.e., had 
eligible SPs). In this report, the term "eligible SP" refers specifically to household members 
designated for Intake interviews by the sampling process described in Section 2.5. The results of the 


DU sampling for the first year of the study are summarized in Table 2-5. 


Table 2-5. Results of DU sampling for the CSFII/DHKS 1994 


Number of Number of | Number of 
DUs Number of | number of | Number of | occupied occupied | Number of 
selected for |} DUs added | vacant or | DUs with |DUs with no|nonrespond- 
sample non-DUs | eligible SP | eligible SPs 


*Nonresponding DUs were those for which a Screener was not completed. 


2.5 Selection of Sample Persons for Intake Interviews 


The approach used to select persons for the Intake interviews was to designate subsets of 
households within which persons meeting specified sex-age-income criteria would be included in the 
study. For example, for a predesignated subset of households in the DU sample, only children 
between the ages of 1 and 2 years were to be selected for the Intake interviews. In another subset of 
households, only children between the ages of 1 and 2 years and low-income males between the ages of 
50 and 59 years were to be included in the sample. In yet another subset of households, all household 
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members | year of age or older were to be included in the sample. Sampled households were assigned 
to the various subsets in a random fashion to ensure the unbiased selection of SPs for the study. In 
addition, all infants under 1 year of age in households that contained at least one SP 1 year or older 
were included in the sample. 


To facilitate the selection of SPs in the field, each Screener Questionnaire carried a 
sampling message specifying the characteristics of the persons to be included in the sample. A total of 
24 distinct sampling messages were developed for the first year of the survey. The proportion of 
households receiving a particular message was determined to Satisfy the target sampling rates for the 
various sex-age-income domains. The number and configuration of the sampling messages was a 
function of these sampling rates. Section 2.5.1 discusses the derivation of the sampling rates that were 
used to design the sampling messages for the first year of the study. Section 2.5.2 describes how the 
final set of messages was formed by collapsing domains having similar sampling rates. Section 2.5.3 
describes how households were classified into income classes for sampling purposes. Finally, Section 
2.5.4 summarizes the results of the SP sampling process for the CSFII/DHKS 1994. 


2.5.1 Derivation of Sampling Rates 


The form of the sampling messages required to select SPs was determined as follows. 
First, estimates of the number of persons in each sex-age-income domain were obtained from the 
March 1992 Current Population Survey (CPS) public use data file. These population estimates are 
summarized in column (5) of Table 2-6. The low-income designation noted in column (4) refers to 
persons in households with incomes below 130 percent of Federal poverty guidelines. The CPS 
estimates given in this table include adjustments to compensate for the known undercounting of certain 
groups of individuals. Therefore, they were expected to be somewhat larger than the corresponding 
counts to be obtained from the CSFII/DHKS listing operations. If the CPS estimates were used to 
derive the sampling rates for the CSFII/DHKS, the resulting sample sizes would likely have been 
smaller than desired. Thus, to avoid underestimating the required sampling rates, coverage rates from 
the 1992 National Health Interview Survey (NHIS) were applied to the March 1992 CPS counts to 
obtain estimates of the numbers of persons who would be covered by an area probability sample. The 
NHIS coverage rates used in these calculations are shown in column (6) of Table 2-6, and the resulting 


population counts ("unadjusted for undercoverage") are given in column (7). 
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Table 2-6. 1992 CPS population counts adjusted for undercoverage, by sex, age, and income group 


(1) (4) (5) (6) (7) 
Income Estimated 
Sex-age- level based on 130 | March 1992 CPS population count, 
income Age group | percent of Federal | weighted population} 1992 NHIS unadjusted for 
domain poverty guidelines count (1,000s) coverage rate | undercoverage 
1 Non-low : : 2,428 
2 Non-low : 3.1 D1 
i) Non-low 3 ‘ 7,869 
4 Non-low f ; 9,956 
5 Non-low : ; 13,925 
6 Non-low : ‘ 16,205 
ad Non-low ; i 12,973 
8 Non-low 3 ; 8,810 
9 Non-low : : 7,606 
10 Non-low } 6,072 
11 Non-low . 5 2,469 
12 Non-low ‘ ; Sa 
13 Non-low h : bt wt 
14 Non-low A . 9,610 
15 Non-low ; ; 13,028 
16 Non-low : 16,854 
i Non-low : fs 14,230 
18 Non-low . ; 9,385 
19 Non-low ; . 8,303 
20 Non-low A : aE 
21 1,184 
22 I ey 
23 2,758 
24 25126 
ohn) 2,264 
26 2,249 
o4 | 1322 
28 1,034 
29 1,239 
30 1,487 
31 1,118 
32 1,552 
33 2,863 
34 2,92) 
35 3,446 
36 3,471 
ay 1,884 
38 1,542 
39 23254 
40 3,883 
Total ee ae viceroy 224,434 
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For the reasons given above, the sampling rates for the CSFII/DHKS 1994 were based on 
the estimated population counts in column (7) of Table 2-6 rather than the actual CPS counts in column 
(5). The target sample sizes specified for all 3 years of the CSFII/DHKS are summarized in column 
(4) of Table 2-7. Note that the sample sizes are Specified separately for the all-income sample and the 
low-income sample. Also note that the population counts in the upper half of column (5) refer to the 
all-income group rather than just the non-low-income group, as in Table 2-6. Column (6) gives the 
corresponding "initial" sampling rates (expressed in units of 0.001) obtained by dividing the target 
sample size by the corresponding population count in column (5). Columns (7) and (8) of the table 
give the expected numbers of non-low- and low-income SPs, respectively, in the all-income sample, 
assuming that the initial rates in the upper half of column (6) are used to select the sample. In other 
words, the sample sizes shown in columns (7) and (8) of Table 2-7 are those that would be expected if 


there were no supplementation of low-income persons. 


Based on the results shown in column (8) of Table 2-7, it appeared that the all-income 
sampling rates [i.e., the initial rates given in the upper half of column (6)] for five of the sex-age 
domains [those denoted with an asterisk in column (9)] would be sufficient to provide the required 
numbers of low-income SPs. For these five sex-age groups, it would not be necessary to supplement 
the sample of low-income SPs. However, for the remaining 15 sex-age groups, varying amounts of 


Supplementation would be necessary to achieve the required low-income sample sizes. 


The rates at which low-income SPs would have to be sampled to meet the specified 
targets are given in the lower half of column (6) of Table 2-7. We refer to these rates as To , where 


g denotes the sex-age group. For the 15 sex-age groups requiring supplementary low-income samples, 


the required sampling rate for the low-income group, po , 1S greater than or equal to oe , where i 


is the corresponding sampling rate for the all-income sample given in the upper half of column (6) of 
Table 2-7. For example, for males 6 to 11 years of age, ee = 0.0750, which is greater than rem = 


0.0677. 


Because the overall low-income rate, pe , 1s designed to yield 207 SPs for each sex-age 


group, we can define the "required" number of non-low-income SPs in a given sex-age group as 


ere re — 207, where nei is the all-income sample size target given in the upper half of column 


(4) of Table 2-7. The implied sampling rate for non-low-income persons is then 
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Table 2-7. Sample size targets specified for the CSFII/DHKS, initial sampling rates, and expected 
sample sizes based on initial rates 


Sex-age-income group (4) (5) (6) (7) (8) (9) 
(1) (2) (3) Population Expected Expected 
counts based Initial number of | number of | Sample for 
CSFII/DHKS| onCPS_ |sampling rate] non-low- | low-income sex-age 
Age sample totals and (X 1,000) | income SPs | SPsinall- | group meets 
group Income target (all NHIS corresp. to | in all-income income __|target for low 
Sex (years) group 3 years) coverage target sample sample income 
Male 1-2 All “ 
Male 3-5 All e 


Male 6-11 All 
Male 12-19 All 
Male 20-29 All 
Male 30-39 All 
Male 40-49 All 
Male 50-59 All 
Male 60-69 All 
Male 70+ All 
Female 1-2 All 
Female 3-5 All 
Female 6-11 All 
Female 12-19 All 
Female 20-29 All 
Female 30-39 All 
Female 40-49 All 
Female 50-59 All 
Female 60-69 All 
Female 70+ All 


Male 1-2 Low 
Male 3-5 Low 
Male 6-11 Low 
Male 12-19 Low 
Male 20-29 Low 
Male 30-39 Low 
Male 40-49 Low 
Male 50-59 Low 
Male 60-69 Low 
Male 70+ Low 
Female 1-2 Low 
Female 3-5 Low 


Female 6-11 Low 
Female 12-19 Low 
Female 20-29 Low 
Female 30-39 Low 
Female 40-49 Low 
Female 50-59 Low 
Female 60-69 Low 
Female 70+ Low 


54 53 53 53 53 53 53 59 59 59 62 £9 £9 fa fa ca fa Fa Ba Se 
cRCECECE EERE CECE CECE CECE SESE SESE SESE 


XX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 
xX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 
XxX 
XX 
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where Neo is the non-low-income population count given in the last column of Table 2-6. 


Column (6) of Table 2-8 summarizes these “adjusted" rates. The corresponding rates for the low- 
income sample are given in the lower half of column (6) of Table 2-8. The low-income sampling rates 
are the same as those given in the lower half of column (6) of Table 2-7, except in the case of the five 
Starred age-sex groups, where they are the sampling rates for the corresponding non-low-income 
group. The rates in column (6) of Table 2-8 were used to construct the final sampling messages, as 


described in the next section. 


2.5.2 Construction of Sampling Messages and Allocation to Households 


Let r; denote the "adjusted" sampling rate for the i-th Sex-age-income group given in 
columns (6) and (7) of Table 2-8. To establish the sampling messages required for the CSFII/DHKS 
1994, the rows of Table 2-8 were ordered by r; from smallest to largest, and sex-age-income groups 
with similar values of 7; were collapsed as shown in Table 2-9 [see column (5)]. The largest 7; within 
a collapsed group was used for all detailed sex-age-income groups comprising the collapsed group. 
These "final" rates are shown in column (6) of Table 2-9. The 24 collapsed groups identified in 
column (5) of Table 2-9 correspond to the 24 sampling messages used in the first year of the study. 


Table 2-10 lists the 24 sampling messages in terms of the characteristics of the persons to 
be included in the sample. The proportion of DUs that were assigned to sampling message i is shown 
in the last column of this table and was calculated from the formula: 

prop; = a 
where r, is the corresponding final sampling rate given in column (6) of Table 2-9, r,41 is the final 
sampling rate given in the preceding row of the table (where r,, = 0 by definition), and r, = 0.2004 
is the largest sampling rate (corresponding to the last row of the table). The sampled DUs within each 
PSU were then randomly assigned to the various messages in the proportions given in column (7) of 
Table 2-9. This was accomplished by computing Npyprop; (rounded to the nearest integer) for each 
message 7 = 1, 2, ..., 24, where Npy is the number of sampled DUs in the PSU, and then randomly 


assigning the required number of DUs to message i. 
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Table 2-8. Adjusted sampling rates by sex-age-income group 


Sex-age-income group 


(1) 


Sex 


Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 


Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Male 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 
Female 


(2) 


Age group 
(years) 


1-2 
3-5 
6-11 
12-19 
20-29 
30-39 
40-49 
50-59 
60-69 
70+ 
1-2 
3-5 
6-11 
12-19 
20-29 
30-39 
40-49 
50-59 
60-69 
70+ 


1-2 
3-5 
6-11 
12719 
20-29 
30-39 
40-49 
50-59 
60-69 
70+ 
1-2 
3-5 
6-11 
12-19 
20-29 
30-39 
40-49 
50-59 
60-69 
70+ 


(3) 


Income 


Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 
Non-low 


Low 


(5) 


Population Actual sample 
counts based on| targets for non- 
CPS totals and | low- and low- 
NHIS coverage | income groups 
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(6) 


Adjusted 
sampling rate 
(X 1,000) 


0.1991 
0.1370 
0.0651 
0.0514 
0.0421 
0.0397 
0.0496 
0.0730 
0.0845 
0.0965 
0.2004 
0.1363 
0.0694 
0.0533 
0.0408 
0.0348 
0.0452 
0.0685 
0.0706 
0.0650 


0.1991 
0.1370 
0.0750 
0.0759 
0.0915 
0.0920 
0.1565 
0.2002 
0.1671 
0.1392 
0.2004 
0.1363 
0.0723 
0.0709 
0.0601 
0.0596 
0.1099 
0.1342 
0.0920 
0.0650 


Table 2-9. Final sampling rates and proportion of households assigned to each message, 
by sex-age-income group 


Sex-age-income group (4) (5) (7) 
Proportion of 
(1) (2) (3) Adjusted Sampling Final sampling | households in 
Age sampling rate |message number|rate for sex-age- sample 
group for sex-age- for CSFII/ income group assigned to 
Sex (years) Tncame income group DHKS 1994 (0.001s) message 
Female 30-39 All 0.1735 
Male 30-39 All 0.0245 
Female 20-29 All 0.0058 
Male 20-29 All 0.0062 
Female 40-49 All 0.0155 
Male 40-49 All 0.0218 
Male 12-19 All 0.0093 
Female 12-19 All 0.0093 
Female 30-39 Low 0.0339 
Female 20-29 Low 0.0339 
Female 70+ All 0.0249 
Female 70+ Low 0.0249 
Male 6-11 All 0.0249 
Female 50-59 All 0.0216 
Female 6-11 All 0.0216 
Female 60-69 All 0.0073 
Female 12-19 Low 0.0073 
Female 6-11 Low 0.0105 
Male 50-59 All 0.0105 
Male 6-11 Low 0.0147 
Male 12-19 Low 0.0147 
Male 60-69 All 0.0429 
Male 20-29 Low 2 0.0374 
Female 60-69 Low 9 0.0374 
Male 30-39 Low 9 0.0374 
Male 70+ All 8 0.0223 
Female 40-49 Low 7 0.0667 
Female 50-59 Low 6 0.1215 
Female 3-5 All a 0.0138 
Female 3-5 Low 5 0.0138 
Male 3-5 Low 5 0.0138 
Male 3-5 All > 0.0138 
Male 70+ Low 4 0.0111 
Male 40-49 Low 3 0.0863 
Male 60-69 Low Zz 0.0527 
Male 1-2 All 1 0.1663 
Male 1-2 Low 1 0.1663 
Male 50-59 Low 1 0.1663 
Female 1-2 All 1 0.1663 
Female 1-2 Low 1 0.1663 
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Table 2-10. Sampling messages used in the CSFII/DHKS 1994 


Characteristics of persons to be included in sample 


Proportion 
of households 
Message assigned 
number All income Low income All income Low income message 


1 1-2 1-2 0.1663 
2 1-2 1-2 0.0527 
3 1-2 1-2 0.0863 
4 1-2 1-2 0.0111 
5 1-5 1-5 0.0138 
6 1-5 1-5 50-59 0.1215 
7 5 1-5 40-59 0.0667 
8 1s 70-5 1-5 40-59 0.0223 
9 1-5, 70+ 1-5 40-69 0.0374 
10 1-5, 60+ 1-5 40-69 0.0429 
7 {5"b0+ 1-5 40-69 0.0147 
12 1-5, 50+ 1-5 6-11, 40-69 | 0.0105 
13 1-5, 50+ 1-5, 60-69 | 6-19, 40-59 | 0.0073 
14 1-5, 50+ 1-11, 50-69 | 12-19, 40-49 | 0.0216 
15 1s e 1-11, 50+ | 12-19, 40-49 | 0.0249 
16 1-11, 50+ 1-11, 50+ 12-49 0.0339 
17 1-11, 50+ 1-19, 50+ 20-49 0.0093 
18 1-19, 50+ 1-19, 50+ 20-49 0.0093 
19 1-19, 404 1-19, 50+ 20-49 0.0218 
20 1-19, 40+ 1-19, 40+ 20-39 0.0155 
21 1-29, 40+ 1-19, 40+ 20-39 0.0062 
22 1-29, 40+ 1-29, 40+ 30-39 0.0058 
23 pt 1-29, 40+ 30-39 6.0245 
24 es pas 0.1735 
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25:3 Classification of Households to Income Classes 


Under the procedures adopted for the CSFII/DHKS, the Screener question on income 
status (Q S14) was asked only when necessary during screening because of the belief that asking about 
income during the initial contact with the household might increase nonresponse to the survey. 
Therefore, if the sampling message indicated that income information was unnecessary for sampling, 
the question was not asked. For example, message 24 indicated that all persons (1 year of age or 
Older) in these households were to be included in the sample regardless of income level. Similarly, if a 
household was assigned message 1 ("select persons 1 to 2 years of age and low-income males 50 to 59 
years of age"), but the household did not include males 50 to 59 years of age, the sampling of SPs 
could proceed without collecting income data in the Screener. In all such cases, the income 
information was obtained from the more detailed Household Questionnaire, using an identically 
worded question (Q H47a). 


Occasionally, the interviewers were unable to obtain the income information necessary to 
select SPs for the Intake interviews. In such cases, a rule based on the composition of the household 
was used to assign the household to one of the income groups for sampling purposes. The rule used 
was the following: If the household contained one or more children under 6 years of age, but no males 
18 years of age or over, the household was treated as low income for sampling purposes. Otherwise, 
the household was treated as non-low income. This rule was expected to be reasonably effective in 
identifying low-income households because more than 60 percent of children under 6 years of age 
living in households headed by a female with related children under 6 years and no spouse present are 


living below Federal poverty guidelines.> 


It should be noted that the above rule was adopted simply to facilitate the sampling of SPs 
in the field. Some households that were classified as low income by this rule may have turned out to 
be non-low income, and vice versa. For base weighting purposes, such households were weighted 
according to their income status as determined by the sampling rule, and not their actual income status 
based on Q H47a of the Household Questionnaire (see Section 5.1). However, for the purpose of 
determining sample yields, the response to either Q S14 of the Screener Questionnaire or Q H47a of 


the Household Questionnaire (and not the sampling rule) will be used to establish income status. 


5 Current Population Reports, Poverty in the United States: 1990, Series P-60, No. 175. 
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Table 2-11 summarizes the distribution of the sampled households by income level (as 
reported in either the Screener or Household Questionnaire) and sampling message. Of the 3,266 
households with eligible SPs, 374 were classified as low income (below 130% of Federal poverty 
guidelines) by Q S14 of the Screener Questionnaire and 451 were classified as low income by Q H47a 
of the Household Questionnaire, for a total of 825 low-income households. A total of 1,958 
households were classified as non-low income by either Q $14 or Q H47a. Of the 483 households in 
the table that did not provide any income data, 385 did not complete the Household Questionnaire and 
98 completed the Household Questionnaire but refused to answer question Q H47a. The latter 98 
cases account for approximately 3 percent of the 2,813 households that completed the Household 
Questionnaire. In what follows, persons in the 825 low-income households are referred to as low- 
income SPs and persons in the 1,958 non-low-income households are referred to as non-low-income 
SPs. 


2.5.4 Results of SP Sampling Process 


Tables 2-12 through 2-14 summarize the results of the SP sampling process for the 
CSFII/DHKS 1994. The classification of cases in Tables 2-13 and 2-14 into income classes was based 
on either Q S14 of the Screener Questionnaire or Q H47a of the Household Questionnaire, as 
described in Section 2.5.3. 


Table 2-12 summarizes the number of sample DUs, the number of vacant or non-DUs, 
the number of households with and without eligible SPs, the number of SPs in households with SPs, 
and the average numbers of SPs per household with an SP, by sampling message. This table contains 
important sampling-related information that was used to monitor the sampling process. In particular, it 
should be noted that with the 24 sampling messages used in the first year of the study, 39 percent of 
the occupied households had an eligible SP, and within these households, an average of slightly more 
than two SPs were sampled per household. The results given in columns (6) and’ (7) of the table are 
reasonably consistent with independent estimates obtained from tabulations of the CPS public use data 
file. Finally, the numbers of SPs completing the Intake interviews are shown in columns (8) and (9) of 
this table. 
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Table 2-11. Distribution of sampled households by sampling source of income data and income 
level* and sampling message 


A. Income required for selection of SPs 


C. Reported in D. Assigned in Screener B. Income not required for 
Screener QS14 based on rule selection of SPs 


(6A) (6B) (9A) (9B) 


Income | Income 


Income Income not not 
not not reported | reported 
Low |Non-low| reported | reported on on 
income | income on on income | income | Screener | Screener 
Screener |based on|based on or or 
or House- House- | House- 
hold hold hold hold 
Samp- 1 : : Quest. Quest. : - | Quest. Quest. 
ling | eligible i i (HH disp | (HH disp 
messa SPs = HO1T)| + HO17T) 
1 2 8 
22 0 1 
3 3 3 
4 0 0 
5 0 1 
6 5 12 
I 3 1 
8 1 5 
9 2 2 
10 1 3 
ti 0 0 
12 0 4 
13 0 2 
14 0 5 
15 2 12 
16 6 13 
17 0 1 
18 1 3 
19 0 14 
20 4 14 
21 2 3 
22 0 10 
3 fy 23 
4 210 


* Low-income households are those with incomes below 130 percent of Federal poverty guidelines. All others are considered non-low 
income. 


* An HH (Household Questionnaire) disposition code of HO1 refers to a "completed household questionnaire." All other codes are 
nonrespondents or ineligibles. 
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Table 2-12. Number of DUs and SPs selected for the CSFII/DHKS 1994 and number of SPs completing 
the Day 1 Intake interview, by sampling message 


(6) (7) (8) (9) 
Number of 
Average | Proportion | Number of SPs 
Number of | Number of | Number of | number of | of occupied | SPs com- | completing 
Total Number of | households | households SPs in SPs per | households | pleting Day | both days of 
Sampling | number of | vacant or | with atleast} with no households | household | with eligible} 1 Intake Intake 
p with SPs_| with an SP SPs interview | interviews 
1 85 
2 29 
3 66 
4 8 
5 26 
6 220 
7 130 
8 58 
9 83 
10 147 
11 47 
12 Sie 
13 29 
14 119 
1S 169 
16 302 
a7 94 
18 110 
19 221 
20 207 
21 60 
22 73 
23 356 
24 2,603 


9,628 1,161 3,266 5,067 6,868 0.3919 5,589 


* Screener disposition code of S07. 


An SP is a person having the characteristics specified in the sampling message. Households with at least one SP have Screener disposition 
codes of $01, S02, and S03. 


**Screener disposition codes of S04, S05, and S06. 
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Table 2-13. Number of SPs eligible for the Intake interviews and number completing one or 
both days of Intake interviews, by sex-age-income domain* 


Low-income households All households 


Number of Number of Number of 
eligible SPs | Number of SPs Number of | Number of SPs 
in low- SPs completing | eligible SPs SPs completing 
income completing | Day 1 and |inall-income| completing Day 1 and 
Sex-age households | Day 1 Intake | Day 2 Intake | households | Day 1 Intake | Day 2 Intake 
Males 
<1 year 28 58 
1-2 years 89 246 
3-5 years 99 289 
6-11 years 68 253 
12-19 years 106 266 
20-29 years 129 244 
30-39 years 100 296 
40-49 years 103 287 
50-59 years 70 255 
60-69 years 65 232 
70+ years 68 233 
Females 
<1 year B2 68 
1-2 years 91 235 
3-5 years 106 295 
6-11 years 77 253 
12-19 years 85 261 
20-29 years 115 256 
30-39 years 91 7299) 
40-49 years 92 286 
50-59 years 68 274 
60-69 years 61 231 
70+ years 70 216 
Total, excluding 
children less than 1,753 1,595 1,511 6,716 5,459 5,185 
1 year old 
Total 1,813 1,649 6,864 5,589 


*Table excludes four SPs who became ineligible before completing the Day 1 Intake (disposition code of F30). 


Classification by sex and age includes imputed values. See Section 5.1.5. 
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Table 2-14. Number of SPs completing the Day 1 Intake interviews and corresponding sample 
size target by sex-age-income domain 


Low-income households All households 


Number of 
eligible SPs 


Number of Number of | Number of 


in low- SPs Sample eligible SPs SPs Sample 
income completing target for |in all-income} completing target for 
Sex-age* households | Day 1 Intake | Day 1 Intake | households | Day 1 Intake | Day 1 Intake 
Males 
<1 year 25 NA 
1-2 years 86 240 
3-5 years 89 240 
6-11 years 65 240 
12-19 years 97 240 
20-29 years 264 
30-39 years 86 284 
40-49 years 82 284 
50-59 years 61 284 
60-69 years 58 284 
70+ years 59 264 
Females 
<1 year 29 NA 79 NA 
1-2 years 87 69 HT 240 
3-5 years 69 336 240 
6-11 years 74 69 302 240 
12-19 years 79 69 328 240 
20-29 years 69 342 © 248 
30-39 years 87 69 346 264 
40-49 years 82 69 369 284 
50-59 years 66 69 369 292 284 
60-69 years =I) 69 314 243 264 
70+ years 70 64 69 299 241 240 
Total, excluding 
children less than 1,753 1,595 1,380 6,716 5,459 5,168 


Total 1,813 1,649 1,380 6,8647 5,589 5,168 


* Classification by sex and age includes imputed values. See Section 5.1.5. 


T Table excludes four SPs who became ineligible before completing the Day 1 Intake (disposition code of F30). 
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Table 2-13 summarizes the number of SPs eligible for the Intake interviews and the 
corresponding numbers completing one or both days of Intake interviews, by sex-age-income domain. 
Table 2-14 compares the number of SPs completing one day of Intake interviews with the 
corresponding annual sample size target by sex-age-income domain. The "targets" given in Table 2-14 
are one-third of the 3-year numerical goals specified for the CSFII/DHKS (see Table 2-1). As Table 
2-14 shows, the sample yields for the CSFIJ/DHKS 1994 generally met or exceeded the designated 


targets, with some exceptions. Shortfalls occurred in the following analytical domains: 


I! All-income males ages 50 to 59 years; 
Ds All-income males ages 60 to 69 years; 
3. All-income males ages 70+ years; 


4. All-income females ages 60 to 69 years; 


> 


ay. Low-income males ages 6 to 11 years; 

6. Low-income males ages 50 to 59 years; 
of, Low-income males ages 60 to 69 years; 
8. Low-income males ages 70+ years; 

oO; Low-income females ages 50 to 59 years; 


10. Low-income females ages 60 to 69 years; and 


11. Low-income females ages 70+ years. 


For those domains where the actual yield exceeded the 1-year sample size target, the 
excess was often substantial (e.g., for persons under 19 years of age). For the CSFII/DHKS 1995, 
revised sampling rates were therefore implemented to (1) adjust for the expected shortfalls in the 
domains listed above and (2) keep the sample sizes within the desired ranges for the entire 3-year 


project. 
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2.6 Selection of SPs for the Diet and Health Knowledge Survey 


SPs who were 20 years of age or older and who had completed the Day 1 Intake 
interview without the assistance of a proxy (disposition code of F01) were also eligible for the DHKS. 
SPs were selected for the DHKS in the field using a specially designed sampling program in each 
interviewer's laptop computer. If there were two or more eligible respondents in the household, the 
sampling program randomly selected one for the DHKS. Approximately one-half of the households 
had more than one eligible SP for the DHKS. Table 2-15 summarizes the numbers of SPs selected for 
and responding to the DHKS, by income group and the number of eligible SPs in the household. 


Table 2-15. Number of SPs selected for and completing the DHKS, by income group and 
number of eligible SPs in household 


Number of 
eligible SPs in 
household 
(persons Number of | Number of SPs | Number of SPs 
Income completing SPs completing | selected for completing 
: Day 1 Intake)* DHKS 
Low income 380 
180 
27 
4 or more 3 
Total low 585 
income 
All income 924 
846 
90 
4 or more 19 
Total all 1,879 


income 


*Completing Intake without the assistance of a proxy (disposition code of F01). 
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Unlike the Intake interviews, there were no specific numerical sample size targets for the 
DHKS. However, there was the requirement that the distribution of DHKS respondents be "similar" 
to that of the corresponding Intake respondents by sex, age, and income. Although it was recognized 
that restricting the DHKS sample to only one respondent per household might distort the distribution 
of DHKS respondents somewhat, the random sampling procedures used to select DHKS respondents 
were reasonably effective in meeting the study goals. As Table 2-16 shows, the distribution of SPs 
selected for the DHKS and the corresponding distribution of DHKS respondents are generally 
comparable to the distributions of SPs completing the Day 1 Intake interview. Note that in Table 2-16, 
the number of SPs completing the Day 1 Intake includes 5,517 SPs who completed the Day 1 Intake 
interview and 72 SPs whose Intake was provided by a proxy for the SP (Intake disposition code FQ2). 


Table 2-16. Number of SPs completing Day 1 Intake and number completing the DHKS, by 
sex, age, and income 


Day 1 Intake* DHKS DHKS 
= ac vs 
g Percent | Number | Percent | Number 


Percent 


Male 
20-39 years 
40-59 years 
60+ years 

Female 
20-39 years 
40-59 years 
60+ years 


Total 


All income 


*Intake disposition codes of FO1 and F02. 
T Excludes two SPs who became ineligible before completing the DHKS (disposition code of D30). 
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2.7 Issues in Sampling Implementation 


In general, the sampling procedures developed for the CSFII/DHKS 1994 worked well. 
However, it is worth noting two areas that required some adjustments during the course of the study. 
The first was the reduction in Year 1 of the initial sample of DUs from slightly over 11,000 to 9,500. 
The original projection of 11,000 DUs was based on rough initial assumptions about the distribution of 
SPs within households in the United States. These distributions were subsequently updated using more 
current CPS information. The latter analysis suggested that a smaller sample of 9,500 DUs would be 
sufficient for the CSFII/DHKS 1994. 


The second area requiring adjustment was the modification of the sampling messages for 
Year 2. Although the initial screening sample of 9,500 DUs did in fact yield more SPs than required 
for the survey year, there were some shortfalls for some sex-age-income domains and considerable 
surpluses for others (see Table 2-14). Although it was recognized that sampling variability probably 
accounted for much of the variation in sample sizes, a decision was made to "fine tune" the sampling 
rates for the second year. In adjusting the sampling rates for Year 2, both upward and downward 
adjustments were made. The goal was to achieve as closely as possible two-thirds of the CSFII/DHKS 
sample size targets by the end of the second survey year. As a result of these adjustments, the number 
(and configuration) of sampling messages for Year 2 was reduced from 24 to 21, and the number of 


DUs included in the screening sample was increased to 11,500. 
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3. DATA COLLECTION 


3.1 Introduction 


Following the Pilot Study, Westat worked in close collaboration with the Agricultural 
Research Service, United States Department of Agriculture (ARS, USDA), to evaluate and revise the 
materials and procedures for the Continuing Survey of Food Intakes by Individuals and the Diet and 
Health Knowledge Survey (CSFII/DHKS).' Revisions were made to the Pilot Study questionnaires, 
interviewer materials, quality control procedures, and field management systems. 


Five regional supervisors and five senior interviewers were trained in December 1993 and 
assisted in the January 1994 interviewer training. A total of 90 interviewers (10 of whom are 
bilingual) were trained to conduct the CSFII/DHKS 1994. 


The data collection period for the CSFII/DHKS 1994 extended over 13 months beginning 
on January 14, 1994. During this time period, 8,333 occupied households were screened; 2,813 
Household Questionnaires were completed; 5,589 Day 1 and 5,311 Day 2 Intake interviews were 
administered; and 1,879 DHKS Questionnaires were conducted, primarily over the telephone. 
Interviewing activities (including the time spent contacting sampled households, administering the 
questionnaires, traveling to and from respondents' homes, editing completed work, and reporting to the 
supervisors) required about 60,000 interviewer hours. 


The following sections describe the questionnaires, questionnaire aids, training activities, 
and quality control and management of the data collection for the CSFII/DHKS 1994. 


1 The "public-friendly” name of the survey is "What We Eat in America 1994-1996." This name appears on all survey questionnaires, 
interviewer materials, and respondent letters. 
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3.2 Data Collection Materials 


3.2.1 Questionnaires 


The design of the CSFII/DHKS required that interviewers administer the questionnaires 
described below to households or eligible sample persons (SPs). 


= A Screener Questionnaire was administered to identify eligible SPs in the sampled 
households. 


= Two 24-hour food intake interviews (the Day 1 and Day 2 Intakes) were 
completed with each SP; the contract required that the Day 2 Intake be 
administered between 3 and 10 days after the Day 1 Intake and on a different day 
of the week. 


a The Household Questionnaire collected socioeconomic data and was administered 
in person to a knowledgeable household respondent 18 years or older, not 
necessarily an SP. 


B The DHKS Questionnaire was completed with a selected SP 20 years of age or 


older who had completed a Day 1 Intake without the assistance of a proxy. The 
DHKS was to be completed 2 to 3 weeks after the second Intake interview. 


Table 3-1 shows the average time to administer each questionnaire. The times are 
consistent with those negotiated with ARS at the start of the contract. . 


Table 3-1. Average questionnaire administration time 


Average 
administration time 


Questionnaire type 


Screener 

Household Questionnaire 
Day 1 Intake 

Day 2 Intake 

DHKS 


“Includes interviews conducted in person and over the telephone. 


The Day 2 Intake was completed over the telephone with 152 (3%) respondents. The 
average administration time for these telephone Intake interviews was 22.8 minutes. A total of 294 
(5%) DHKS interviews were conducted in person. The average administration time for an in-person 


DHKS interview was 34.3 minutes. 


The data collection instruments are described in greater detail in the following 
paragraphs. The instruments are included as Attachment 3.A. 


Screener Questionnaire 


The Screener Questionnaire contained 19 questions. It was designed to collect 
information about the household that allowed the interviewer to follow the sampling procedures to 
determine if the household was eligible for the survey and to select the SPs to be interviewed. To 
accomplish this objective, the Screener contained the elements described below: 


a An initial verification of the address of the sampled DU; 


r A household enumeration that obtained age, date of birth, sex, race and ethnicity, 
and relationship to a reference person for each usual resident of the DU; 


= A question for determining if household income was above or below a specified 
level (for the purpose of determining poverty status), which was used when income 
data were required to sample SPs; and 

2 A computer-generated sampling message specifying the characteristics of the 
persons selected to be SPs. 


The Screener also included instructions for conducting the missed dwelling unit (DU) procedure (see 
Section 2.4.4) and a listing sheet for recording the addresses of new DUs. 


Household Questionnaire 


The Household Questionnaire contained 65 questions, including detailed household 
income questions as well as questions on food shopping practices; employment status; participation in 


Government food programs such as the school lunch program, WIC, and the Food Stamp Program; 


source of food; and food sufficiency. 


Day 1 and Day 2 Intake Questionnaires 


The Day 1 and Day 2 Intake Questionnaires contained 41 and 17 questions, respectively. 
The questionnaires elicited a report of all foods and beverages the SP had consumed between midnight 
and midnight the day before the interview. The SP was first asked to enumerate all food and drink 
consumed, without any probing and with as little interruption as possible by the interviewer. Then the 
interviewer probed for the time of day and the eating occasion for each food item, obtained a complete 
description that would permit the food to be coded so that nutrient values could be determined, and 
asked the SP to estimate the quantity consumed. A review of all reported foods was then conducted to 
allow the SP to remember and report additional foods that might have been forgotten. In concluding 
the questions on foods eaten, the interviewer asked where each food had been obtained, whether it had 
been eaten at home, and, if not, whether it was ever at home. The final series of questions in the 
interview were health-related questions, such as the SP's exercise habits, prior and current cigarette- 
smoking behavior, food allergies, and height and weight. 


Measuring guides were used to assist the SP in recalling food quantities. These guides 
included stainless steel measuring cups and spoons, a 12-inch ruler, a set of thickness sticks, and a 


plastic 2-cup liquid measuring cup. 


Diet and Health Knowledge Survey Questionnaire 


The DHKS Questionnaire collected information about the SP's attitudes, knowledge, and 
behaviors concerning diet and health issues. The 42 questions addressed such topics as the importance 
of dietary guidance, awareness of diet-health relationships, food labeling, and behavior related to fat 
intake and food safety. 
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S262 Questionnaire Aids 


Several documents and materials were used in conjunction with the questionnaires. These 
are described below. 


ia Food Instruction Booklet (FIB). The FIB was used by the interviewer during the 
Intake interview and contained a series of standardized probes specific to the 
various foods that the SP might report. The probes were designed to elicit the 
detailed description and quantity information needed to code the data with the 
desired level of information and were therefore very important to the quality of the 
Intake data collected. The FIB also contained recording conventions, standard 
abbreviations, an index for locating foods, and instructions for using the 
measurement aids when estimating food quantities. 


§ Measuring Guides. Measuring guides were used in conducting the Intake 
interviews to quantify the foods and beverages consumed. Included were laminated 
cards that illustrate fish and chicken parts and circles that help the SP quantify the 
size of a pancake, for example. Also included were a set of four stainless steel 
measuring cups and five measuring spoons; eight 1/8"-thick sticks for estimating 
the thickness of meat, poultry, and cheese; a ruler for reporting dimensions in 
inches; and a liquid pint measuring cup. 


a Handcards. These cards list response options and were shown to respondents 
when asking sensitive questions such as income or a question with a long list of 
response categories. 


al Household and DHKS Folders. The Folders contained DU identification 
information and the interviewer's records of all attempts to complete the interviews 
associated with the DU. Additionally, the Household Folder contained space to 
record the results of telephone calls to collect Intake data not available at the time 
of interview. 


a Non-interview Report Form. This form documented the reason for each instance 
of nonresponse. The form also provided a mechanism for interviewers to record 
information that might have facilitated the completion of the case during a 
subsequent contact. For the DHKS, this form was incorporated into the DHKS 
Folder. 


a DHKS postcard. A colorful DHKS postcard was developed to serve two 
purposes: (1) to remind the SP of the interview appointment and (2) to provide the 
SP with the response categories required to answer many of the questions so the 
interviewer did not have to repeat them. 


3.2.3 Improvements to the Pilot Study Questionnaires and Aids 


The Pilot Study questionnaires provided the framework for developing the Main Survey 
data collection instruments and aids for the CSFII/DHKS 1994. To capture experiences from the Pilot 
Study, Westat had the interviewers maintain a diary of all problems and issues they encountered, 
complete a Debriefing Questionnaire, and attend an in-person debriefing. Taped interviews and field 
observations also provided information for identifying areas of improvement. After the results of the 
Pilot Study had been summarized, Westat met with ARS staff to revise the questionnaires for the Main 


Survey. 


The significant differences between the Pilot Study and Main Survey questionnaires are 
described below. 


a Screener Questionnaire. The rules for selecting SPs to be interviewed when 
income information was not asked were simplified. This simplification eliminated 
the need for two versions of the Screener Questionnaire and altered the wording of 
the income questions. Other formatting improvements were made to the Screener 
to reduce interviewer error. 


a Household Questionnaire. The income questions were improved for ease and 
accuracy of interviewer recording. The head-of-household questions were also 
redesigned to minimize interviewer and respondent confusion. 


= Day 1 Intake Questionnaire. The series of food intake review questions was 
moved so that they occurred right after the collection of the detailed description 
and quantity of each food reported. In the Pilot Study, the review was conducted 
at the end of the entire series of food intake questions. Other changes included 
revising interviewer instructions to clarify the administration of the instrument. 
The revisions to the Day 1 and Day 2 Intake Questionnaires are summarized in 
Attachment 3.B. 


7 Day 2 Intake Questionnaire. All revisions to the Day 1 Intake Questionnaire 
were also made to the Day 2 instrument. In addition, the food list in Q17 was 
reordered and other foods were added. 


5 DHKS Questionnaire. An introductory paragraph and a recording line for the 
SP's name were added to the cover. Also, the random start reminder boxes were 
moved to be more obvious to the interviewer. Minor wording changes were made 
to a few questions, and a skip pattern was developed for respondents who did not 
use food label information. 


3-6 


The significant changes to the questionnaire aids made between the Pilot Study and the 
Main Survey are described below. 


a Food Instruction Booklet (FIB). ARS and Westat staff worked Closely to revise 
the FIB for the Main Survey, finalizing it in November 1993, with some further 
refinements in July 1994. (The specific changes made with each revision are 
included as Attachment 3.C.) 


w The major change to the FIB was to replace the prompts in the food categories with 
standardized probes about each food. For example, the biscuit TYPE prompt was 
changed from "from mix, refrigerated dough, home recipe?" to the probe "Was it 
from a mix, refrigerated dough, home recipe, ready-to-eat...?". Other areas of 
modification primarily involved format standardization. For example: 


- Interviewer recording instructions were standardized. 


~ Icons were added for Additions, Sandwiches, Recipes, Salt, and Fat, as a 
visual cue to the interviewers that more specific recording guidelines could 
be found in the instructions section of the FIB. 


~ Heading names (called hangers) and heading order within subcategories 
were standardized as much as possible. 


- Pictures of poultry parts, and wedge and cylinder shapes were added to 
subcategories as reminders of how to quantify foods such as chicken, pie, 
and sausage. 


- Fast-food restaurants included in Survey Net were listed in the FIB fast-food 
subcategory so that the interviewers were clear on when the fast-food probes 
should be used in collecting detailed food descriptions and amounts. 


The midyear 1994 revisions to the FIB involved expanding the Sandwiches, Salads, 
Soups category to include four new sandwich subcategories (Bacon, Sausage, BLT 
Sandwiches; Beef, Pork, Ham, Chicken, Turkey, Vegetarian Sandwiches; Egg, 
Egg Salad Sandwiches; and Fish, Shellfish Sandwiches). Probes were also 
standardized across categories and were moved or modified within categories to 
improve the flow, clarify probes, or collect more information. 


a Handcards. The handcards were changed, as necessary, to reflect the changes in 
the questionnaires. 


= Household Folder. Spaces to enter the DU's telephone number and the 
interviewer's name were added to the Folder cover. A second Followup Call 
Record was added to the inside of the Folder, allowing interviewers to record 
missing meal information for two SPs in a DU. 


a Measuring guides. Information was added to the laminated card that the SP 
referenced when reporting some food quantities. Additions included pictures of 
pieces of poultry and fish and various shapes with dimensions. 


si DHKS Folder. The DHKS Folder was separated from the Household Folder. 


3.2.4 Introductory Materials 


The likelihood of respondent cooperation is increased if the legitimacy and importance of 
the survey are established in the respondent's eyes. Therefore, in advance of the Pilot Study, ARS and 
Westat made considerable effort to develop a set of promotional materials that would convince 
respondents of the survey's legitimacy and importance. Appearance, content, and wording were all 
important considerations. ARS and Westat agreed that a "public-friendly" survey name, "What We 
Eat in America 1994-1996," would appear on all materials. The Pilot Study materials worked well 
and, except for redesigning the survey logo, minimal changes were made in preparation for the 
CSFII/DHKS 1994. 


The introductory materials included a Westat toll-free telephone number so that SPs could 
call if they desired more information. For each call received on the hotline, information was recorded 
and passed along, via E-mail, to the regional supervisor and the interviewer assigned to the case. A 
total of 130 calls were received during the CSFII/DHKS 1994. Of these callers, 11 percent requested 
additional information about the study; 15 percent wanted to verify the legitimacy of the study; 17 
percent wanted to set an appointment, reschedule an appointment, or contact a particular interviewer; 
and 57 percent were calling for other reasons but generally expressed an unwillingness to participate in 
the survey. 


The interviewer assigned to the case and his or her supervisor were contacted via E-mail 
when a respondent called in to set an appointment. The message included information on respondent 
availability and a request that the interviewer contact the respondent to arrange for an interview. The 
Message was tagged with a "Receipt Request" and a telephone call was placed to the interviewer if the 
request was not returned in a timely fashion. 


When a respondent called in and expressed an unwillingness to participate, the field 
director tried to convert the refusal by identifying the underlying reason for the resistance and 
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providing additional information about the survey and the data uses. If the respondent did not agree to 
participate, the field director and the supervisor considered the case a final refusal or attempted another 
refusal conversion strategy. 


The materials that the interviewers used to explain the survey to the respondents, 


establish their legitimacy, and respond to their questions are described below. 


wm Introductory letter. The letter briefly described the survey, its importance, and 
the authority for collecting the data and pledged strict adherence to protect 
respondent confidentiality. The letter was printed on USDA letterhead and signed 
by the ARS Contract Officer's Representative. The letter was mailed early enough 
to arrive in advance of the interviewer's initial visit. Only minor editorial changes 
were made to the letter as a result of the Pilot Study. 


a Brochure. The brochure had as its basic goals the promotion and legitimization of 
the survey. The brochure and introductory letter were mailed together. This 
colorful brochure attempted to answer questions respondents frequently ask about 
surveys. Revisions after the Pilot Study included adding a statement concerning 
the availability of USDA programs and some changes to the graphics. 


a Nonresponse conversion letters. A basic conversion letter for respondents who 
could not be contacted, were too busy to participate, or were not interested in 
participating provided additional information about the survey and stressed the 
importance of participation. A letter addressed to elderly respondents and women 
living alone suggested that they might be more comfortable if a friend or relative 
was with them at the time of interview. Managers of limited-access buildings and 
communities were encouraged to provide access to sampled DUs so that the 
residents of sampled units would have an opportunity to participate. All of the 
letters were printed on Westat letterhead and signed by the field director. The 
letter often included the name of the interviewer assigned to the case. Letters were 
requested by the regional supervisor and sent from the home office. 


= Flyers. The flyers provided a brief overview of the survey and made a visual 
statement with colorful graphics. One flyer was targeted to adults and the other to 
teenagers. The flyers were used at the interviewer's discretion during refusal 
conversion or with reluctant respondents. The appropriate flyer was also included 
with each nonresponse conversion letter sent from the home office. The only 
change to the two 1-page flyers was the substitution of the new logo. 


2 Factbook. A loose-leaf factbook was developed for use by interviewers if they 
thought it would help in gaining SP cooperation. The factbook was intended to 
show the uses of the survey by including newspaper and periodical articles 
describing the findings of previous food consumption surveys and related topics. 
Endorsement letters were also included in the factbook. ARS prepared a 


comprehensive press release that described the study and how the data were used. 
Releases were mailed to 247 newspapers in early February 1994. Westat employed 
Burrelle's Clipping Service to locate newspaper articles about the study. Twenty- 
four articles were located by this service and provided to interviewers for their 
factbooks. Throughout the survey year, additional newspaper articles and press 
releases about the CSFII/DHKS were mailed to the interviewers as they appeared 
in print. 


im Tote bag. Each interviewer received a large heavy-canvas tote bag with sturdy 
webbed handle-straps for carrying supplies into the field. The tote bag was 
imprinted with the survey logo, an additional visual cue legitimizing the survey. 


= Photo identification badge. Interviewers were instructed to wear the laminated 
photo identification badges issued by Westat when collecting data for the 
CSFII/DHKS. Because the identification badge was illustrated and had been 
described in the advance materials, wearing the badge on an outer garment assured 
the respondent of the interviewer's credibility. 


3.2.5 Spanish Language Questionnaires and Materials 


All survey materials administered to or shared with primarily Spanish-speaking 
respondents were translated into Spanish and printed. These materials included the introductory letter, 
the survey brochure, the flyers, the questionnaires, the hand cards, and the DHKS postcard. 
Translated documents standardized materials used in approaching and interviewing primarily Spanish- 
speaking respondents. 


All materials were translated by a native Spanish-speaking Westat employee and back- 
translated by an independent contractor whose first language was Spanish and who had professional 
experience as a translator for government agencies. To check the accuracy and utility of the 
translation, the back-translator received a copy of the materials translated into Spanish and translated 
them "blinded" into English. The translator checked the original English against the back-translated 
English for changes in meaning. When questions arose, the translator and the back-translator 
consulted on the most accurate translation. 
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3.3 Field Staff Training 
3.3.1 Lister Training 


In August 1993, regional supervisors hired 53 field staff, 47 of whom had previous listing 
experience and 6 of whom did not, to list the segments selected for the CSFII/DHKS 1994. (See 
Section 2.4.1 for a description of listing procedures.) All listers were trained through a home study 
program that included a review of the listing manual, written exercises, and a 50-minute videotape. 


The home study package consisted of three sections: 
1. A presentation of the definitions and instructions used for listing (this section 
served as a reference manual during listing); 
Za Review and practice exercises; and 


33 A final review test covering all material presented. 


After completing the exercises and the final test, the interviewers mailed them to their 
supervisors for review. Upon successful completion of home study, listing assignments were shipped 
to the lister. Listers were required to submit their first two completed segments to their supervisors 
for review. New listers were also observed in the field by either a supervisor or an experienced lister. 


3.3.2 Project-Specific Training 
3.3.2.1 Training Materials 


To thoroughly prepare field staff for their responsibilities, Westat developed two 
reference documents. ARS staff provided materials to be incorporated into these documents, and they 


reviewed and commented on them. The documents were the following: 


= Supervisor/Senior Interviewer Manual. This document, used exclusively by field 
supervisors and senior interviewers, covered supervisory responsibilities, including 
setting up a regional office, case assignment and reassignment to interviewers, 
monitoring field progress and response rates, reporting to the home office, quality 
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control of interviewers’ work, and using the production and cost reports to monitor 
work. 


] Interviewer Manual. This document contained two distinct sections: 


Part 1: Field Procedures. This section contained background information on the 
survey and study-specific data collection procedures. Included were requirements 
for contacting respondents and answering their questions, administering the 
questionnaires, selecting SPs, and scheduling interviews. 


Part 2: Question-by-Question Specifications. This section contained detailed 
examples, explanations, and definitions for each question in the questionnaires. 


Westat also developed a Trainer's Guide that included all lecture scripts, role plays, and 
written exercises involved in training. Trainers were required to use the Trainer's Guide to ensure 


standardization of the materials presented to interviewers. 


Westat also developed an Interviewer's Guide to the Field Management System (FMS). 
(See Section 3.4.2.2 for a more detailed description of the FMS.) This manual provided information 
about the computer and its use and detailed instructions for entering and transmitting data to the home 
Office. 


3.3.2.2 Supervisor/Senior Interviewer Training 


The supervisors and senior interviewers attended an 8-day training session from 
December 7 through December 15, 1993. The session was held in Bethesda, Maryland. The first 6 
days of the session were a dress rehearsal for interviewer training. The last 2 days of the session were 
devoted to supervisory responsibilities, including assigning work to interviewers, monitoring field 
progress, conducting validation interviews and observations, and reviewing taped interviews. The 14 
staff members who were going to serve as food coders attended a portion of the supervisor training to 
learn about the Intake instruments, the FIB, and data collection procedures. Attachment 3.D is a copy 
of the Supervisor Training Agenda. 


At the end of each day of training, Westat and ARS staff met to evaluate the training. 


During the 2 weeks between the supervisor and the interviewer training sessions, minor changes were 
made to the materials to reflect what had been learned from supervisor training. 
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3.3.2.3 Interviewer Training 


Eighty-two field interviewers were trained in a 7-day session conducted between January 
7 and January 13, 1994, in Dallas, Texas. Ten of the 82 interviewers were new to Westat and were 
trained on Westat's general interviewing procedures in a 5-hour session held the day before the 
project-specific training. At the conclusion of the 7-day session, the 10 bilingual interviewers received 
an additional day of training on the Spanish language questionnaires and materials. During the course 
of the year, eight additional interviewers were trained to replace interviewers who had quit or were 
released. (The Interviewer Training Agenda is included as Attachment 3.E.) 


Westat's basic approach to training is to maximize trainee involvement and participation 
and to provide ample opportunity for supervisory staff to observe and evaluate trainee performance. 
To accomplish this goal, the training was conducted in small groups of about 15 interviewers (referred 
to as "communities") where interviewers could receive closer attention and be given extensive hands- 
on experience with the questionnaires, the FIB, and the food measuring guides. Samples of numerous 
food packages were displayed and demonstrations of measuring techniques were given so that trainees 
could familiarize themselves with food labels, package sizes, and various shapes and sizes of glasses, 
cups, and bowls. Training scripts and exercises were designed to provide situations that the 
interviewers were likely to encounter and to build in complexity. The following techniques were used 


to train the interviewers on all survey questionnaires. 


ws Home study. All trainees were required to study the field procedures section of 
the Interviewer Manual and the FIB before attending training. Interviewers were 
required to complete exercises based on this material and bring them to training for 
supervisory review and feedback. 


a Demonstration interview. Two members of the training staff demonstrated a Day 
1 Intake interview using measuring guides, the FIB, and "real" food products. 
This technique was used to provide trainees with a general sense of the flow of an 
Intake interview. 


m Interactive lectures. The basic concepts of the questionnaires were taught through 
interactive lectures to communities of about 15 interviewers. The trainees were led 
through the questionnaires and called on to act the role of the interviewer while the 
trainer played the respondent. The trainer stopped frequently to explain a question 
more fully or to make a particular point about a question or its administration. 


is Mock interviews. In their communities (or minicommunities of seven 
interviewers), trainees were also exposed to increasingly more complex material. 


These sessions gave trainees more hands-on practice and allowed trainers to closely 
monitor interviewer performance. During these sessions, trainees actually used 
food labels, packages, and measuring guides and measured quantities using glasses, 
cups, and bowls. 


= Role plays. Supervisors arranged trainees in pairs, taking into consideration the 
Strengths and weaknesses of the interviewers. Within each pair, one trainee took 
the role of the interviewer while the other played the SP, using prepared scripts. 
They then reversed roles. Training staff observed the pairs, correcting the 
interviewers if needed. 


= Paid respondents. During training, each trainee had the opportunity to interview 
respondents who were brought into the training session. This allowed them to 
practice in an unscripted situation and provided a more realistic experience of what 
they would encounter with "real" respondents. The trainees were arranged in 
groups of four, and each group conducted four Intake interviews. The first two 
interviews were with an adult and a 6- to- 11-year-old child being assisted by the 
adult, and the last two were with an adult and the same adult acting as a proxy for 
a child under 6 years old. Each trainee interviewed a respondent while the others 
observed and recorded the responses. Training staff observed the interviews and 
provided feedback to the trainees at the completion of the session. 


= Food displays. A variety of food items and types of packaging were set out on a 
table in each training room. These products were used throughout the training to 
provide the trainees with realistic practice with actual food packages. 


= Exercises. Written exercises were used to reinforce the learning of particular 
concepts or to give the trainees an opportunity to practice on their own (e.g., 
editing the Intake Questionnaire or selecting SPs). 


a Plenary review. ARS and Westat staff met at the end of each training day to 
discuss the training presentations and the problems interviewers were having and to 
resolve any issues that arose during the day's sessions. On the last day of training, 
all trainees were brought together in a large group session. Westat staff reviewed 
decisions made by ARS and Westat during training, answered any remaining 
questions, and provided a final review of particularly complex concepts or 
procedures. ARS presented information about the uses of the survey data. 


+ 


After returning home, interviewers were required to complete a practice interview with a 
neighbor or family member and a scripted mock interview by telephone with their supervisor or senior 
interviewer. After supervisory review of the practice interview and successful completion of the mock 


interview, supervisors authorized the interviewers to begin work on their assignments. 
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3.3.2.4 Periodic Training Quizzes 


Periodic quizzes were developed and administered by supervisors over the telephone to 
the interviewers (see Attachment 3.F). The quizzes were used to assess the interviewer's 
understanding of complex areas of the questionnaires that were sources of common interviewer error. 
The supervisor provided retraining on the questions that the interviewer had handled incorrectly in the 


quiz. The supervisors graded the quizzes and reported the grades to the field director. 


The five quizzes administered during the year focused on the Intake review, the DHKS 
health conditions questions (Q5 and Q6), recording sandwich ingredients in the Intake, the income 
questions in the Household Questionnaire, and SP selection procedures. At the beginning of Quarter 
2, the supervisors also conducted a mock telephone Intake with eight interviewers who were not 


providing adequate detail in describing foods eaten. 


3.4 Conduct of the Fieldwork 
3.4.1 Field Organization 


The 62 primary sampling units (PSUs) were divided into five geographic regions: 
Northeast, Mid-Atlantic and South, Midwest, Southwest, and West Coast. Each of the five 
supervisors was responsible for one region consisting of about 12 PSUs and 16 interviewers. 
Supervisors assigned work to their interviewers and monitored production, costs, and the quality of 
work. Each supervisor worked with a senior interviewer, who was available to travel to all PSUs in 
the region to convert nonresponse cases and observe the interviewers at work. In addition to a 
traveling assignment, each senior interviewer had a small interviewing assignment in her home PSU. 


Based on the workload in a PSU, 36 PSUs were staffed with one interviewer and 26 
PSUs were staffed with two interviewers. Ten of the interviewers were bilingual in English and 


Spanish. 


3.4.1.1 Recruiting Field Staff 


Westat employs its field staff of supervisors and interviewers directly and does not use 
field services. The five regional supervisors hired for the CSFII/DHKS 1994 had extensive 
supervisory experience with Westat. Two of the five supervisors had worked on the CSFII/DHKS 
Pilot Study. 


The primary resource for recruiting interviewers is Westat's own files of approximately 
4,000 persons who have worked on one of its field studies in the past 3 years. Extensive computer and 
manual records are maintained on every person who has held or applied for a position on Westat's 
field staff. In recruiting for the CSFII/DHKS 1994, this was the first source consulted for 
interviewers. Supervisors received lists of candidates that contained information about relevant 
interviewing experience. If unable to find a suitable candidate from the Westat list of interviewers, 
supervisors also used their own contacts with other survey organizations. In 59 of the 62 PSUs, 
supervisors were able to hire interviewers from these sources. In three PSUs, it was necessary to 


place advertisements in the local newspapers and interview candidates. 


In accordance with requirements set forth in the Statement of Work, the following criteria 
were considered in selecting staff for the CSFII/DHKS 1994: 


5 Interviewing experience; 

a An ability to work with the public; 

= Basic reading and math skills; 

= Experience in buying, planning, and preparing food; 

a Basic knowledge of food measurement and preparation; and 


a Experience on surveys requiring households to participate in multiple interviews. 


The characteristics of the 90 interviewers and 5 senior interviewers trained during the 
CSFI/DHKS 1994 are shown in Table 3-2. The staff consisted of 81 females and 14 males. Eighty- 
one percent of the interviewers had worked for Westat on a prior survey and 47 percent had more than 
5 years of interviewing experience. Additionally, about 80 percent had some college education or had 
obtained an advanced degree. 
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Table 3-2. Interviewer characteristics* 


Characteristics n=81 n=14 n=95 


Survey experience (years) 

None 

<a t 

1-5 

6-10 

11-15 

16-20 

> 21 


Education 
High school graduate 
Some college 
Associate's degree 
Bachelor's degree 
Master's degree 


*Includes characteristics of five senior interviewers. 


3.4.1.2 Interviewer Attrition 


Eighty-two interviewers were trained at the first training session in January 1994, and an 
additional eight interviewers were trained during the year. Of the original 82 interviewers, 3 were 
released immediately after the training (1 for poor performance and 2 for personal reasons). During 
the year, 15 interviewers resigned for personal reasons and 2 were released for poor performance. 
Thus, 20 (22%) of the 90 interviewers trained for the CSFII/DHKS 1994 terminated their employment. 


This percentage is similar to Westat's experience on other long-term surveys. 


Two of the five senior interviewers left their positions by choice. One took a full-time 


job and the other continued as an interviewer but was unable to complete the travel required of the 
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senior interviewers. They were replaced by two interviewers who had worked on the survey since 
January 1994 and had demonstrated their ability to achieve high response rates and complete interviews 
with few errors. Each had more than 6 years of interviewing experience with Westat. The regional 
supervisors provided in-depth telephone training on the duties of a senior interviewer, including 
procedures for evaluating taped interviews, conducting in-person observations, and assisting with 


validations. 


3.4.2 Management 
3.4.2.1 Reporting Structure 


Every interviewer had a weekly telephone conference with his or her supervisor to report 
on the work completed during the week and plans for completing his or her assignment. The 
supervisor used the Field Management System (FMS) reports (the FMS is described in Section 3.4.2.2) 
to discuss interviewer productivity, costs, and data quality. 


Following the weekly conferences with their interviewers, the supervisors reported to 
Westat's field director in the home office. These telephone conferences between the supervisors and 
the field director were focused on resolving issues of interviewer performance and assignments, 
response rates, and data quality. Supervisors also had to report on their progress in completing quality 
control procedures. 


3.4.2.2 Field Management System (FMS) 


Westat developed the FMS to enable the field supervisory and project management staff 
to maintain close control over the data collection effort. Field interviewers received laptop computers 
with modems that held the system software for the FMS. Each supervisor was also given a laptop 
computer with the FMS software and relevant case assignment information for her region. 
Interviewers entered status codes and information about each sampled DU and SP, as well as time and 
expense information. Once a week, interviewers transmitted their data to the home office, which in 
turn transmitted relevant data to the field supervisors. 
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Weekly reports were generated and used by supervisors and the home office to monitor 
production, response rates, and costs associated with the data collection. Specialized reports were also 
produced that allowed supervisors to monitor whether survey procedures were being followed. For 
example, reports were generated to show the percentage of Day 1 Intake interviews completed on each 
day of the week, because a goal of the study was to have an even distribution of interviews across the 
days of the week. Reports were also generated to show whether the Day 2 interview was being 
conducted 3 to 10 days after the Day 1 interview, as required by the survey procedures. These reports 
were provided at the interviewer and PSU level for the supervisors and for each PSU and supervisory 
region for the home office. 


3.4.3 Data Collection Procedures 
3.4.3.1 Introduction 


The data collection procedures for the CSFII/DHKS 1994 were numerous and complex. 
Adhering to all procedures while still achieving the response rates specified in the contract was a 
delicate balance that required close attention to the field work and careful judgment about when and 
how corrective action should be taken. Westat and ARS staff worked together on decisions concerning 
the appropriate action needed to meet the procedural requirements. The data collection procedures are 
summarized in Exhibit 3-1 and described in this section of the report. 


3.4.3.2 Contact Protocol 


The interviewer's first task was to conduct a screening interview with each sampled DU. 
The objective of the screening effort was to select a specified number of low-income and non-low- 
income males and females of selected age groups, in accordance with the sample design requirements.’ 
Interviewers were instructed to administer the Screener Questionnaire in person with a household 


member 18 years of age or older. 


1 The contract requires that the sample be drawn in such a way that, within each of the 3 years of data collection, the distribution of SPs 
approximates the overall distribution across sex-age groups. It further specifies that each sample stratum and PSU must be sampled in 
every quarter of the year. Therefore, within the 62 PSUs, the 36 segments selected for the 3 survey years were divided into 12 sets of 3 
segments each, and a set of 3 segments per PSU was assigned for fieldwork for each of the 12 quarters of the 3-year survey period. 
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Screener 


Household 
Questionnaire 


Day 1 Intake 
Questionnaire 


Day 2 Intake 
Questionnaire 


DHKS 


Exhibit 3-1. Summary of data collection procedures 


Respondent Administration 
18 years or older __ 


Main food preparer or In-Person 
meal planner for the HH 
SP or In-Person 
Adult Proxy: 
* child SP under 6 
® In combination with 
child SP 6-11 
= Mentally or 
physically impaired 


or another adult 

knowledgeable about 

household characteristics, 

especially income. Does 

SP or adult proxy as In-Person. 

detailed above. In a small 
number of cases 

by telephone 


not have to be an SP. 

only if approved 
by Supervisor 
in advance. 
Telephone. 
In-person for 
special situations 
approved in 
advance by 
Supervisor. 


SP 20 years of age or 
older who has completed 
Day 1 interview. 

Selected by FMS. 
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Contact Rules 
Contact on one of specified Day 1 
Intake interview days, if possible. 
Attempt to complete on same day 
as Screener and Day 1 Intake 
interview. Setting up an 
appointment is permissible only if 
HHQ respondent is not an SP or 
is an SP and has completed both 
Intake interviews or is an SP and 
has not completed the Day 1 
Intake AND NO OTHER SP in 
the household has completed an 
Intake. 
Conduct on 1 of 3 days specified 
on the assignment label. 
Appointment is permissible if no 
Day 1 Intakes are completed in 
the HH. An appointment can be 
made with one, some, or all SPs 
in the HH if the appointment is 
for the same date and time. Only 
one appointment/visit is allowed 
per HH and it must be to 
administer the first Day 1 
Intake(s) in the HH. No 
additional appointments are 
permitted. 
Conduct 3-10 days after Day 1 
interview and on a different day 
of the week. No appointments 
permissible. 


Conduct 2-3 weeks after the Day 
2 interview. Schedule an 
appointment after conducting the 
Day 2 interview. 


After multiple unsuccessful attempts to complete the Screener with the sampled DU, the 
interviewer attempted to collect only limited age and sex information from a household member 18 
years of age or older. Based on the information provided, the interviewer followed the SP selection 
instructions in the Screener. If SPs were selected, the interviewer attempted to contact the SPs to 
complete the Screener and the necessary interviews. This procedure was used to complete 503, or 6 
percent, of the Screeners. 


When interviewers were unable to obtain screening information from the sampled DU, 
they followed procedures for approaching neighbors to collect information about the household 
members living at the selected address. Specifically, after the second unsuccessful attempt to obtain 
screening information from the sampled DU, the interviewer approached a "neighbor" (who could be 
someone living next door, a postman, an apartment manager, a storekeeper, or anyone who was likely 
to know something about the household composition) to obtain the age and sex of the residents of the 
sampled DU. After a third unsuccessful attempt, the interviewer contacted a second neighbor and 
confirmed the information obtained from the first informant. After a fourth unsuccessful contact 
attempt, the case was finalized as having been completed with neighbor information. Based on the 
information provided by the neighbor, the interviewer followed the SP selection instructions in the 
Screener. If SPs were selected, the interviewer continued his or her efforts to contact the sampled 


household to complete the Screener and the necessary interviews. 


If SPs were selected as a result of the screening interview, the Household Questionnaire 
was usually the next instrument administered. The interviewers had discretion, however, to complete 
the Intake interviews before administering the Household Questionnaire. Interviewers might exercise 
this option for a number of reasons: (1) a qualified Household Questionnaire respondent was 
unavailable; (2) an SP would be unavailable for the Day 1 Intake if the Household Questionnaire was 
completed first; or (3) the interviewer thought that the income questions in the Household 
Questionnaire might result in a refusal to the Intake interviews. The respondent to the Household 
Questionnaire did not have to be an SP. The preferred respondent was the main food preparer or 
planner for the household. When that person was unavailable, another household member who was 
knowledgeable about the household, particularly about household income information, was asked to 


respond. 


Day 1 Intake interviews were to be conducted in person. Whenever possible, the 
interviewers conducted the first Day 1 Intake interview with the SP who was the main meal preparer. 
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This procedure was developed because the main preparer is best able to describe the ingredients used 
in dishes prepared at home. His or her report could then be used as a reference for the home-prepared 
foods eaten by other SPs. A knowledgeable adult in the household was also asked to complete the 
Intake interview for all SPs under 6 years of age and to assist SPs 6 to 11 years of age in reporting 
food and beverages consumed. SPs 12 years of age and older reported for themselves. Proxy 
reporting was required to complete 72 Day 1 Intake interviews and 68 Day 2 interviews because the SP 
had a physical or mental handicap that interfered with the ability to self-report. Examples of SPs 
requiring proxy interviews include terminally ill patients and stroke victims. Interviewers were 
allowed to make up to three in-person visits to obtain a Day 1 Intake interview and could make 
additional visits if authorized by the supervisor. Although the supervisor could authorize that Intake 
interviews be conducted by telephone if necessary, no CSFII/DHKS 1994 Day 1 Intakes were 
conducted by telephone. 


The Day 2 Intake interview was conducted with SPs who had completed a Day 1 Intake 
interview. The interview was also to be conducted in person. If in-person administration was 
impossible, the supervisor was permitted to approve a small number of telephone interviews. A total 
of 152, or 3 percent, of the Day 2 Intake interviews were conducted by telephone. Of these, 63 
interviews were approved because the Day 1 Intake had been completed by a traveling interviewer who 
was no longer in the PSU at the time of the Day 2 interview. Another 52 interviews were completed 
by telephone because the SP was unavailable or refused to be interviewed in person. Table 3-3 shows 


the reasons supervisors approved telephone interviews. 


Table 3-3. Day 2 Intake Questionnaires completed by telephone 


No local interviewer in PSU 


Only way respondent could/would participate 


Nonresponse conversion 


Conducted in Spanish, no bilingual interviewers in PSU 
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A respondent to the DHKS Questionnaire was selected in each household with one or 
more SPs 20 years of age or older who had completed a Day 1 Intake interview. The survey 
procedures specified that the DHKS interviews were to be conducted by telephone 2 to 3 weeks after 
the Day 2 Intake. In households without telephones, or if the selected SP was incapable of responding 
to the questionnaire over the telephone, the DHKS was to be conducted in person. A total of 294 
(16%) of the DHKS interviews were completed in person. Table 3-4 shows the frequency of in-person 
DHKS interviews and the reasons that the questionnaire was administered in person. 


Table 3-4. DHKS interviews completed in person 


No telephone 
Respondent's physical limitations (hard of hearing, feeble, etc.) 


Refusal to participate in telephone interview 


Language other than Spanish or English and translator required 


Nonr esponse conver sion 


*A total of 294 DHKS interviews were conducted in person. Documentation was available for 257 of these interviews. In 37 
cases, the interviewer failed to document the reason for conducting the DHKS in person. Procedures have been 
implemented for the CSFII/DHKS 1995 to improve documentation. 


3.4.3.3 Scheduling Protocol 


Procedures for scheduling the Day 1 Intakes were established to meet two requirements: 
i Day 1 Intake interviews were to be completed evenly across the year; and 


2, At least 10 percent of the Day 1 Intake interviews were to be conducted on each 
day of the week. 


A Day 1 Intake was completed by a proxy for 72 SPs. Adult respondents requiring a proxy included persons who were mentally 
handicapped or ill. These SPs were not eligible for DHKS selection. 
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To meet the first requirement in each PSU, all DUs within a segment were randomly 
assigned to be completed within a given quarter of the year. This resulted in the assignment of three 


segments to each quarter of the year. 


Day 1 Intake interviews were generally evenly distributed throughout the year, with 23.1 
percent of the total Day 1 interviews completed in Quarter 1, 24.4 percent in Quarter 2, 26.2 percent 
in Quarter 3, 25.0 percent in Quarter 4, and 1.3 percent in January 1995. Between 1 and 3 percent of 
the SPs did not complete their Day 1 interviews in their assigned quarter and went into the next 
quarter. This occurred primarily because the Screener was completed late in the quarter and the SPs 
could not be interviewed immediately. Table 3-5 shows the number of completed Intake interviews by 
month of the year. The pattern shows that the largest percentage of Intake interviews were completed 
in the months immediately following the release of a new quarter's assignments to interviewers 
(assignments were released on January 17, April 21, July 21, and October 13) and the percentage 


decreased in each succeeding month of the quarter as only the more hard-to-reach cases remained. 


To ensure that at least 10 percent of the interviews were completed on each day of the 
week, Westat developed procedures for assigning each DU a 3-day "window" during which the Day 1 
Intake could be conducted (e.g., Monday/Wednesday/Sunday or Thursday/Friday/Saturday). Two 
patterns were assigned in each segment, allowing the interviewer to work in the segment most days of 
the week. The FMS captured the days on which the Day 1 Intakes were completed and produced 
reports summarizing this information. The supervisors and project managers were able to monitor the 


spread of interviews and to take remedial action if a shortfall was identified on any day of the week. 


Table 3-6 shows that the requirement was met for every day of the week. Remedial 
action was occasionally necessary to ensure that 10 percent of the Day 1 Intake interviews were 
completed on Friday. Although there was no contractual requirement to complete 10 percent of the 
Day 2 Intake interviews across the 7 days of the week, Table 3-7 illustrates that the Day 2 interviews 
were also fairly evenly spread across the week, although fewer than 10 percent of thie Day 2 interviews 
were completed on Sunday. 
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Table 3-5. Day 1 Intake interviews completed by month 


January 1994 
February 
March 
April 

May 

June 

July 
August 
September 
October 
November 


December 


January 1995 


Total CSFII/ 
DHKS 1994 
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Another scheduling requirement was that interviewers were only permitted to make 
appointments for the first Day 1 Intake(s) conducted with SPs in a household. If additional SPs had to 
be interviewed from that same household, the interviewer could not schedule any appointments. The 
reason behind this rule was the belief that SPs‘ eating behavior might be influenced if they knew they 
would have to report their food intake. The same logic applies for the Day 2 interviews; therefore, 
interviewers could not schedule appointments for their Day 2 interviews. Obviously, these restrictions 
made it more difficult for interviewers to find SPs at home to be interviewed. 


Another scheduling protocol required that the Day 2 Intake be conducted within 3 to 10 
days of the Day 1 Intake. Approximately 75 percent of the Day 2 Intake interviews met this survey 
requirement. Table 3-8 shows the frequency of Day 2 Intakes that were not completed within the 3- to 
10-day window and the reason for that occurrence. Approximately 91 percent of the 1,363 mistimed 
Day 2 interviews were conducted more than 10 days after the Day 1 Intake. Of these, 70 percent were 
mistimed because respondents were unavailable within the specified time period, a factor over which 
the interviewers had little control. Also, ARS preferred that Day 2 Intakes be mistimed rather than 
conducted over the telephone. Data not presented in Table 3-8 indicate that, of the Day 2 Intakes 
completed after 10 days, approximately one-third were conducted within 14 days of the Day 1 Intake 
and more than 80 percent were conducted within 30 days of the Day 1 Intake. 


The Day 2 Intake was also to be completed on a different day of the week than the Day 1 
Intake. Table 3-8 also shows that 1.7 percent of the Day 2 interviews were conducted on the same day 
of the week as the Day 1 interview. Therefore, 98.3 percent of Day 2 interviews were conducted in 


accordance with this scheduling requirement. 


Interviewers were instructed to set up an appointment to conduct the DHKS interview by 
telephone within 2 to 3 weeks after the completion of the Day 2 Intake interview in the household (or 
final nonresponse to the Day 2 Intake), as required by the scheduling protocol. The timing of the 
DHKS interview was intended to lower respondent burden and to increase the independence between 
the Intake interviews and the DHKS. Three to 5 days before the scheduled appointment, the 
interviewer mailed the SP a reminder card that listed the appointment day and time or hand delivered 
the card if he or she was at the DU conducting an interview with another SP. Approximately 73 
percent of the DHKS interviews met this requirement. Table 3-9 shows the timing of the DHKS 
interview in relation to the conduct of the Day 2 Intake interview. Of the 511 DHKS interviews that 
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Table 3-8. Mistimed Day 2 Intake interviews 


Conducted Conducted 

less than 3 more than 10 

days after days after 
Day 1 Intake Day 1 Intake 


SP availability 
Weather problems 


Work completed by interviewer 
on travel/status 


Held for nonresponse conversion 
Interviewer error 
Translator availability 


Observer's schedule 


*Percentage of all completed Day 2 Intake interviews. 


Table 3-9. Timing of DHKS interviews 


DUs with 
more than one 
SP 20+: 
All Day 1 
DUs with Intakes 
only one SP conducted on 
Weeks between Day 2 


Intake and DHKS 


Conducted 
same day of 
week as 
— 1 Intake | Total mistimed 


DUs with more 
than one SP 


1,365 


000 


*There were three DHKS Questionnaires with incorrect dates of administration. These have not been included in the table. 
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were not conducted within the prescribed window, 17 percent were completed too soon and 83 percent 
were completed after 3 weeks. Reasons for conducting the DHKS too soon included the respondent's 
expected absence during the prescribed window and interviewer error. Reasons for conducting 
interviews beyond the window period included broken appointments, numerous unsuccessful attempts 
to interview (e.g., the respondent was too busy or not at home), and refusal conversions by another 
interviewer(s). 


Also contributing to the number of DHKS interviews conducted after the window were 
specifications for DHKS respondent selection in households with more than one adult SP. DHKS 
respondent selection requirements specify that one adult per DU be randomly selected from SPs 20 
years of age or older who completed the Day 1 Intake. To ensure that all qualifying SPs in the 
household had a probability of selection, the DHKS respondent was selected after all SPs in the DU 
had completed the Day 1 Intake interview (or been finalized as a nonrespondent). It was not unusual 
for SPs in a household to have their Day 1 Intake interviews conducted at different times during the 
quarter. Therefore, it was possible for some SPs within the same household to have their Day 2 Intake 
interviews completed before other SPs completed their Day 1 Intake interviews. This made it very 
difficult to select the DHKS respondent after all the Day 1 Intake interviews were complete and to 
complete the DHKS 2 to 3 weeks after the Day 2 Intake interview was administered. As shown in 
Table 3-9, 376 DHKS respondents were in multiple SP households that presented the scheduling 
problem and only 63 percent of the DHKS interviews were completed within 2 to 3 weeks. In 
- households with only one SP or multiple SPs who all completed their Day 1 Intakes on the same day, 
75 percent of the DHKS interviews met the scheduling requirement. 
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3.4.3.4 Data Retrieval for Missing Meals 


When conducting Intake interviews for children, it was often necessary to perform data 
retrieval for meals eaten away from home because many children regularly spend time away from their 
parents with a babysitter, in daycare, or in some preschool or school setting. The parent or other 
person most knowledgeable about the child's food consumption at home may have little or no 
information about what the child eats and drinks in settings outside the home. In such cases, the 
interviewer was required to supplement the information provided by the parent with information from 
other sources. Sources contacted included schools, child daycare centers, and babysitters. 


During the Intake interview, the interviewer obtained as much information as possible 
from the SP or proxy before attempting data retrieval for a missing meal. The interviewer was 
responsible for collecting the missing data within 3 days of the interview and usually by telephone. 
The data required depended on the amount of information collected from the SP or proxy and the type 
of data retrieval source. For example, schools typically could provide meal descriptions and quantities 
served whereas babysitters could provide descriptions and quantities eaten. Of the 10,912 Day 1 and 
Day 2 Intakes collected, 197 (less than 2%) required missing meal data retrieval at the time of 
interview. The data retrieval effort was very successful. Of the 197 Intakes requiring retrieval, 
interviewers were unable to collect the missing information in only 10 cases. Table 3-10 summarizes 
the number of Intakes for which data retrieval was performed. 


Table 3-10. Distribution of Intakes requiring data retrieval, by SP age and Intake interview 


20 
197 
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The interviewers reported some problems in scheduling the data retrieval calls and in 
locating the most knowledgeable source to answer the detailed FIB probes. The interviewers also 
encountered some reluctance to provide requested information on the part of school and daycare 
personnel and babysitters. Interviewers overcame this reluctance by providing a thorough explanation 
of the study and, if necessary, mailing or hand delivering the survey brochure. 


All data retrieval contacts were recorded on the Follow-up Call Record in the Household 
Folder. Table 3-11 summarizes contact information for the 197 Intakes requiring data retrieval. In 
most cases, data retrieval involved contacting schools by telephone to collect missing information about 
lunches. Fifty-eight (29%) of the 197 Intakes were missing data from two meals and 27 (14%) were 
missing data from three meals. 


Some data retrieval was also done in-house after the Intake was reviewed and it was 
determined that it did not meet minimum criteria. Refer to Section 4.5.2.2, Minimum Criteria for 
Intakes, for more information about this data retrieval effort. 


3.4.3.5 Respondent Incentives 


Several small gifts were given to SPs to encourage participation in the survey. The set of 
stainless steel measuring cups and spoons that were used as measuring guides for the Intake interview 
was also given to eligible households following the completion of the Screener. An insulated nylon bag 
with the survey logo was presented to each SP before the Day 1 Intake. After completing the Day 2 
Intake, the interviewer gave the SP a travel-type drinking mug, also imprinted with the survey logo, as 
a thank-you for participating. 
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Table 3-11. Summary of contacts to conduct data retrieval 


Sources 
School 
Child daycare 
Babysitter 
Adult daycare 
Other 
Not ascertained 


Type of attempts 
Telephone 164 74.9 
In person 55 25.1 


Missing meal 
Breakfast only 
Lunch only 
Snack only 
Dinner/supper only 
Breakfast and lunch 
Lunch and snack 
Other combination of two meals 
Three meals 
Meal not ascertained 


*For a few cases, both telephone and in-person contacts were required. 
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3.4.3.6 Market Checks 


A market check was requested from ARS whenever an SP reported consuming a food that 
was new on the market, a food specific to a geographic area, or an unknown ethnic food. One market 
check was also requested when an SP reported a new item from a restaurant. For the CSFII/DHKS 
1994, interviewers conducted approximately 185 market checks, purchased 146 products, and sent the 
labels or packages to Westat. Interviewers were unable to locate 31 of the reported foods and 8 “did 
not exist" according to the manufacturers. 


3.5 Data Collection Results 
3.5.1 Achieving Response Rates 


The response rates for the CSFII/DHKS 1994 exceeded the stated goals for all of the 
survey's questionnaires. Table 3-12 summarizes the response rate goals and the rates achieved for 
each questionnaire type. ARS established criteria for when each instrument could be considered 
complete. The response rates were calculated as follows: 


Bi The Screener response rate is the number of DUs screened, divided by the 
number of occupied units selected for screening. Units that were found to be 
vacant or that did not meet the definition of a DU were not included in the 
calculation. 


| The Household Questionnaire response rate is the number of completed 
Household Questionnaires, divided by the number of DUs with selected SPs. 


= The Intake interview response rate is the number of completed Intake 
Questionnaire(s), divided by the total number of selected SPs. 


a The DHKS response rate is the number of completed DHKS Questionnaires, 
divided by the total number of SPs selected for the DHKS. 


Attachment 3.G lists the response rates by questionnaire type for each PSU. The 
response rates in most PSUs were favorable but they do vary because of differences in willingness to 


participate in areas of the country. 
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Table 3-12. Response rates by questionnaire type 


Number of Actual 
Response rate Number completed response 
Questionnaire goal (%) eligible* interviews rate (%) 


Screener 

Household Questionnaire 
Day 1 Intake 

Day 2 Intake 

DHKS 


*Does not include households (N=2) and SPs (N=4 for Day 1, 5 for Day 2 , and 2 for DHKS) who left the population of interest before 
completing the necessary interview. (See Section 6.1 for a discussion of the population of interest.) 


TNinety-five percent of SPs completing the Day 1 Intake also completed the Day 2 Intake. 


A three-phase approach to building response rates was used: 


) Phase 1. Local interviewers worked their assigned cases, making the required 
number of visits to try to complete all necessary interviews with a household. If 
an interviewer was unsuccessful in completing an interview, the case received a 
nonresponse code until the interviewer could consult further with the supervisor. 
After reviewing the Call Record, the supervisor advised the interviewer on when to 
return to the household and how to approach the SP(s). In some cases, the 
Supervisor instructed the interviewer to complete a Non-interview Report Form 
(NIRF) describing the circumstances of the nonresponse and to mail the case 
materials to her. . 


a Phase 2. The supervisor reviewed the NIRF for each nonresponse case. If the 
supervisor believed that conversion was possible, she either returned the case to 
the interviewer for additional work or transferred it to another local interviewer, if 
one was available. If a local interviewer was not available, the work was assigned 
to an interviewer in a nearby PSU. 


a Phase 3. In the final stages of response rate conversion, the supervisor reviewed 
the PSU-level response rates and the NIRFs for the PSU to determine the 
productivity and cost effectiveness of a nonresponse conversion trip by the senior 
interviewer or another experienced interviewer. 
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3.5.2 Contribution of Neighbor Information to Screener Response Rate 


Interviewers were instructed to obtain Screener information from neighbors when the 
members of the selected household refused to participate or when no contact had been established with 
the household after four attempts. (See Section 3.4.3.2 for a discussion of neighbor contact 
procedures.) Of the 8,333 Screener Questionnaires completed at occupied DUs, 886 (10.6%) were 
completed with neighbors. Supplementing household screening with information from a cooperative 
neighbor allowed Westat to achieve a 98.4 percent Screener response rate. Without the 886 cases for 
which the abbreviated household enumeration was completed by a neighbor, the Screener response rate 
would have been 88 percent. 


Table 3-13 categorizes screened households according to the source of Screener 
information (neighbor or household member) and eligibility (whether the household had SPs selected). 
Of the 886 households where the screening information was collected from a neighbor, 82 households 
had selected SPs and 804 were screened out of the survey with no selected SPs. 


Table 3-13. Distribution of households for which a completed Screener Questionnaire was 
obtained, by source of Screener information and household eligibility status 


Screener information from a 
aT 


Screener information from a 
erest aaa member 


Eligibility of household 
Eligible —— — 5 
Ineligible 4,263 84.1 15.9 


To 


* A neighbor is anyone who is not a member of the sampled household (¢.g., mailman, storekeeper, apartment manager, person living 
nearby). 


The interviewers made extensive efforts to complete interviews at eligible households 
identified through neighbors. Of the 205 households initially determined to be eligible through 
neighbor information, 89 Screeners, or 43 percent, were subsequently completed with household 
members and the SPs in most cases went on to complete the Intakes. In another 34 cases, contact was 
attempted with the selected household but cooperation was denied, it was determined that the 
household was ineligible, or the unit was determined to be unoccupied. In 82 cases, contact was not 
established with the selected household and the neighbor's report of household eligibility prevailed. 
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3.5.3 Reasons for Nonresponse 


Table 3-14 illustrates the reasons for nonresponse by questionnaire type. Refusals 
accounted for more than 50 percent of nonresponse for each questionnaire type. The next largest 
category of nonresponse, referred to as maximum attempts, was when the interviewer was not able to 
contact the household. In most cases, the supervisor authorized many more than the required number 


of attempts to complete the interview, but the outcome was unchanged. 


Also contributing to nonresponse were SPs who were too ill to be interviewed, SPs who 
spoke neither English nor Spanish and for whom a suitable translator could not be located (Cyag 
Russian and Polish speakers), SPs who moved and could not be located, and a small number of 
households located in limited-access buildings or communities. Cases of nonresponse involving 
language problems or limited-access buildings or communities were not concentrated in particular 
PSUs. Limited-access buildings and communities received special handling. The interviewer first 
tried to secure the cooperation of the building manager and then persuade the sampled households to 
participate. If building managers resisted, the home office contacted them by telephone or letter to 
explain the survey and the importance of giving selected households an opportunity to participate. If 
this approach was unsuccessful, the cases were classified as nonresponse. 


3.5.4 Demographic Profiles of Respondents and Nonrespondents 


Tables 3-15 through 3-18 present the distributions of respondents and nonrespondents 
with respect to selected demographic and other characteristics. Table 3-15 compares the distribution of 
the Screener Questionnaire respondents with the corresponding distribution of nonrespondents, by 
Census region, MSA status of PSU, and minority status of segment. The "unit of analysis" in Table 
3-15 is an occupied DU (household). Table 3-16 compares the distribution of the Household 
Questionnaire respondents with the corresponding distribution of nonrespondents, by income level and 
number of SPs selected from the household for the Intake interviews. The unit of analysis in this table 
is a household with any eligible SPs. Also, note that the low-income group in this table includes only 
households that were classified as below 130 percent of Federal poverty guidelines on the basis of the 
response to either Screener Questionnaire $14 or Household Questionnaire H47 (i.e., the category does 
not include any households with missing income data). 
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Table 3-15. Distribution of households in screening sample by response status (Screener respondent 
vs. Screener nonrespondent) by region, MSA status, and minority density of segment 


Number of 

households 
MSA Minority | with eligible 
status d 


ensi 
High 
Low 


_Screener respondents 


High 
Low 


Midwest High 


Low 


High 


South 


West 


Low 2.6 
a ae aa ve | 
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Table 3-16. Distribution of households with eligible SPs by Household Questionnaire response status 
(respondent vs. nonrespondent) by income (if available) and number of SPs 


Household Questionnaire response status 
Respondents Nonrespondents 


Percent of Percent of 
Number of | column total | Number of | column total 
Income ee of | households for income | households | for income 
group with SPs group with SPs group 
All income 1,113 39.6 198 43.9 
917 32.6 154 34.1 
783 27.8 99 22.0 


Maes 813 451 100.0 


Low income 1 343 43.0 13 48.1 
2 208 26.1 7 25.9 
Se 247 31.0 i 25.9 
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Table 3-17. Distribution of SPs by Day 1 Intake response status by sex, age, and income 


Day 1 Intake response status 


Respondents Nonrespondents 


umber [Percent of column} Number Percent of 
total for income of column total for 
Sex SPs group SPs income group 


Male 0.6 
25 


Females 


Males 


Females 


1 


Sluyeanaw 
So “NAN KF LR = 


— 
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Table 3-18. Distribution of SPs by Day 1 and Day 2 Intake response status by sex, age, and income 


Day 1 and << 2 Intake response status 
|——sRespondents sd Nonrespondents* 
Percent of Percent of column 
Income column total for} Number of | total for income 
ved group Number of SPs | income group SPs group 
11 


All income 


Sex 


Male 


Female 


Male 


Female 


* Includes SPs who completed a Day 1 Intake but not a Day 2 Intake interview. 
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Tables 3-17 and 3-18 compare the distribution of Intake Questionnaire respondents with 
the corresponding distribution of nonrespondents, by income level, sex, and age. The unit of analysis 
in Tables 3-17 and 3-18 is an SP. Finally, Table 3-18A compares the distribution of SPs selected for 
the DHKS by response status, income level, sex, and age. 


The purpose of these descriptive tables is simply to document some differences between 
the various sets of respondents and nonrespondents. The tables are not intended to give a 
comprehensive analysis of differences between respondents and nonrespondents. Section 5.2, which 
describes the nonresponse weighting adjustment procedures, gives more information about 
demographic and other variables that appear to be related to survey nonresponse. 


As Table 3-15 shows, nonresponse to the Screener Questionnaire was generally very low. 
Any potential bias resulting from Screener nonresponse is therefore likely to be trivial. Nonetheless, 
there are some differences between Screener respondents and nonrespondents. For example, relatively 
more nonrespondents live in the Northeast and West regions compared to respondents (indicating lower 
Screener response rates in the Northeast and West). Similarly, the percentage of Screener 
nonrespondents in the MSA and high-density minority segments tended to be higher than the 
corresponding percentage of nonrespondents. Finally, within the set of Screener respondents, the 
distribution of households with eligible SPs is approximately similar to that of households with no SPs. 


Table 3-16, which shows the distribution of households by Household Questionnaire 
response status, income level, and number of SPs in the household, indicates that a somewhat greater 
percentage of Household Questionnaire nonrespondents are in households with only one SP compared 
to respondents. In general, low-income households were more likely than non-low-income households 
to complete the Household Questionnaire. 


Tables 3-17 and 3-18 indicate that a greater percentage of nonrespondents to the Intake 
interviews were in the 20 to 29 and 50 to 69 age groups when compared with other age groups, 
indicating lower response rates for these groups. Also, a greater percentage of nonrespondents were 
male or non-low-income compared to respondents. The tables also indicate that the drop in 
participation counts from the Day 1 to the Day 2 Intake interview was generally small, with the largest 
drop occurring for SPs in the 20 to 29 and 70+ age groups. 


Finally, the results in Table 3-18A indicate that a greater percentage of DHKS 
respondents were female or in the middle age groups (30-69 years) compared to nonrespondents. 
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Table 3-18A. Distribution of SPs selected for DHKS, by response status by sex, age, and income 


DHKS TH status 
| Respondents Nonrespondents 
Percent of Percent of column 
Income column total for total for income 
Sex group Number of SPs} income group | Number of SPs group 

Male All income 19 
Female 

Male Low income 
Female 


Total 
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3.6 Quality Control Measures and Feedback to Field Staff 


Westat and ARS conducted an ongoing quality control program throughout the year. The 
program consisted of practice interviews completed by the interviewers, review of taped interviews, in- 
person observations of interviews, validation interviews, and regular feedback to the interviewers from 


the home office staff who processed completed questionnaires. 


3.6.1 Quality Control Measures 
3.6.1.1 Practice Interviews 


After completing the 7-day training session, interviewers were instructed to complete 
practice interviews of the Screener, Household, Day 1 and Day 2, and DHKS Questionnaires with a 
neighbor or friend in their home communities. Interviewers mailed their completed practice interviews 
to their supervisors for review. If the interviewer had an unsatisfactory number of errors or 
omissions, the supervisor provided telephone retraining by referring the interviewer to sources in the 
Interviewers Manual or stepping through particular food probes in the FIB. Interviewers also 
completed a scripted Day 1 Intake over the telephone with their supervisors. As soon as the practice 
interview and the telephone Intake had been completed to the supervisor's Satisfaction, the interviewer 
was allowed to begin his or her data collection assignment. 


3.6.1.2 Taped Interviews 


The supervisors continued to monitor the quality of each interviewer's work through a 
series of three tape-recorded interviews. Each interviewer was instructed to tape record one Intake 
interview, either a Day 1 or Day 2 interview that had been administered in person, and two DHKS 
interviews that had been administered over the telephone. Cases to be taped were selected by the 
regional supervisor in consultation with the interviewer. Additionally, 12 taped Household 
Questionnaires were required, and 16 were actually taped because some interviewers taped both the 
Intake and the Household Questionnaire when required to tape the Intake. Westat provided a special 
telephone adapter to ensure a high-quality recording. Respondent permission was secured in advance 
of taping. 
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All taped interviews were mailed to the supervisor or the senior interviewer for 
evaluation. Listening to the tapes allowed the supervisor or senior interviewer to evaluate the 
dynamics of the interviewer-respondent interaction and how the interviewer handled the questionnaires. 
An evaluation form was completed for each tape (see Attachment 3.H), and the results were shared 
with the interviewer. Evaluation items included the interviewer's ability to follow prescribed 
procedures and to use measuring guides, handcards, and the FIB probes. In the DHKS interview, 
supervisors noted whether the interviewer referred to the correct answer categories and used the 
random starts. A sample of tapes were also reviewed by the field director and the project nutritionist 
before being forwarded to ARS for review. 


Table 3-19 summarizes the evaluations of the taped interviews. An overall evaluation 
score was assigned by the evaluator, with 1 being poor and 5 excellent. A score of excellent was 
assigned if the interviewer did not deviate from questionnaire wording. If there was minor 
paraphrasing, the evaluator judged the tape very good or good depending on the amount of 
paraphrasing. Of the 16 tape-recorded Household Questionnaire interviews, all were judged excellent 
or good. Ninety percent of the Intake interviews were excellent to good. In the remaining 10 percent 
of Intakes judged fair or poor, the interviewers either failed to ask all necessary FIB probes or 
paraphrased the review questions. Slightly more than 97 percent of the tape-recorded DHKS 
interviews received an evaluation score of excellent or good. The remaining 3 percent were judged 


fair or poor because of inadequate or inappropriate probing. 


Telephone retraining was provided to the interviewers whenever problems were found 
with any of the instruments. Supervisors followed up on this retraining through Westat's ongoing 


quality control procedures discussed in this section. 


Table 3-19. Evaluation of taped interviews by questionnaire type 


Questionnaire Number of Overall rating* 
ype taped_interviews 


Household Questionnaire 16 Z 10 4 
Day 1 Intake 40 8 19 11 
Day 2 Intake 59 11 29 11 
DHKS 156 66 67 19 
Total 211 87 125 45 


*5 = excellent; 4 = very good; 3 = good; 2 = fair; and 1 = poor. 
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3.6.1.3 In-Person Observations 


Westat's field director and field supervisors, ARS staff, and staff from the U.S. Bureau of 
the Census made in-person observations of interviewers at work. A significant number of observations 
were also conducted by senior interviewers when they were traveling to PSUs to perform nonresponse 


conversion. 


Forty-two interviewers were observed. The senior interviewers observed 18 
interviewers; the regional supervisors, 18; the Westat field director, 2; ARS, 3; and the Census 
Bureau, 1. The observers saw the conduct of 17 Screeners, 14 Household Questionnaires, 33 Day 1 
Intake interviews, and 15 Day 2 Intake interviews. 


Most of the observation occurred in the first 6 months of data collection, with the earliest 
observations being conducted with interviewers who were evaluated as weaker at the January training. 
All of the interviewers trained in April were observed. Later observation trips also tended to focus on 
the weaker interviewers but included observations of other interviewers in the same or a nearby PSU. 
Persons selected for observation by USDA and the Bureau of the Census were selected based on 
location and availability. 


An observation form was completed for each observation conducted by Westat, and the 
results were shared with the interviewer. Generally, the observers were very pleased with the quality 
of the interviewers’ work, their facility in using the FIB, their skill in getting the respondent to use the 
measuring guides and handcards, and their general enthusiasm for the survey. 


3.6.1.4 Validation Procedure 


Westat used validation interviews to verify that an interview had been conducted at the 
assigned address according to survey procedures. Supervisors validated 10 percent of all assigned 
cases. Validation cases were randomly selected and included households with SPs, ineligible 
households, and units reported as vacant. Table 3-20 shows the Screener dispositions for the cases 
selected for validation. The supervisors conducted most validations by telephone; cases without 
telephone numbers were completed in person. 
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Table 3-20. Screener disposition of cases selected for validation 


, Cases selected for validation 
Screener disposition Dia Ca ae ee 


Eligible, household report 

Eligible, abbreviated household report 
Eligible, neighbor report 

Ineligible, household report 

Ineligible, abbreviated household report 
Ineligible, neighbor report 

Vacant, not a DU 
Breakoff 
Refusal 


During the CSFII/DHKS 1994, 993 cases, or 10.3 percent of sampled DUs, were 


validated. The problems uncovered during validations are summarized below: 


i Three cases were initially judged to be a potential problem, but when investigated 
further by the supervisor they proved to be valid. 


el One interviewer mailed to Westat two cases that appeared incomplete. Validation 
interviews were conducted with all of the cases completed by the interviewer and at 
Westat. Of the 17 cases that were validated, 4 were found to be fraudulent. The 
interviewer was dismissed. 


Table 3-21 summarizes the results of the validation procedure. 


Table 3-21. Validation results by level of validation 


Number of cases Number of Validation result codes* 


validated per interviewer 
<10 195 


11-20 685 


21-30 113 


a 
*01 = acceptable; 02 = potential problem; 03 = unacceptable. 
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For the CSFII/DHKS 1995, the percentage of cases preselected for validation has been 
increased from 10 percent to 20 percent to increase the chances of conducting validations from the 33 
percent of selected DUs with eligible SPs. 


3.6.1.5 Quality Review Forms 


A quality review of completed questionnaires was performed at Westat's home office 
before instruments were coded. Coders completed a form documenting the results of the review. 
These forms were forwarded to the field director, who reviewed them before passing all of them on to 
the field supervisors. The supervisors received the forms on a weekly basis and discussed all problems 
with the interviewers. If it helped interviewers to understand their mistakes, the completed 
questionnaires were photocopied and sent to the interviewer. (For a complete discussion of the review, 
see Sections 4.5.2 and 4.6.2.) 


3.6.2 Feedback to the Field Staff 


The quality control measures described above were designed to provide the interviewers 
with timely information about their performance. Several techniques were used to communicate with 
the interviewers and to provide retraining, if appropriate. 


3.6.2.1 E-Mail Communications 


Home office and field staff communicated quickly and efficiently through E-mail. The 
interviewers' laptop computers were loaded with an E-mail utility program that facilitated 
communication on issues that required timely resolution, such as the situations described below. 


L SP selection errors. When the home office's review of a completed Screener 
Questionnaire revealed that an SP had been selected in error, the field director used 
E-mail to inform the supervisor of the problem. The supervisor, in turn, reviewed 
the error with the interviewer and action was taken that would minimize the 
number of interviews completed with the missampled SP. 
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5 Information from toll-free calls. Many of the calls received on the toll-free 
telephone line at Westat were from respondents wishing to reschedule an 
appointment or contact an interviewer. Timely delivery of this information to 
interviewers enhanced the data collection activities. 


2 Data clarification. If a questionnaire item or entry was unclear to coders at the 
home office, E-mail was used to contact the interviewer for clarification. 


a Requests for refusal conversion letters. Supervisors used E-mail to request that 
the home office prepare personalized letters to nonrespondents. 


3.6.2.2 Field Staff Memos 


Westat also prepared two lengthy field staff memos, one mailed in February and the other 
in April (Attachment 3.I). The first memo documented the responses to questions that arose during the 
January in-person training session. This memo was in a question-and-answer format, and interviewers 
were instructed to add it to their manuals. 


The second memo supplemented the spring edition of the newsletter. This memo 
answered questions from the interviewers' diaries that had been collected the previous month. The 
memo also reinforced procedures for conducting screening interviews at seasonal dwellings and 
vacation homes. 


3.6.2.3 Newsletter 


Three issues of the 8-page survey newsletter, Food for Thought, were prepared for the 
field staff. The field director, the director of data processing, the project nutritionist, and ARS staff 
provided input, and humorous stories from the interviewers rounded out each issue. The newsletter 
focused on clarifying questions raised by the interviewers in their interviewer diaries, which were 
provided to the interviewers with instructions to record questions, unusual situations encountered in the 
field, procedural questions, questionnaire item clarification, and issues related to the FIB. Interviewers 
removed completed diary pages from the binder and mailed them to Westat every 4 months. The 
project nutritionist also anticipated such events as holiday meals or picnic foods that might occur in the 
near future and provided reminders on how to use the FIB when reporting these food items. The data 
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preparation manager wrote a column reporting on systematic errors discovered during quality review 


and coding and re-emphasized proper handling of problem areas. 


3.6.2.4 Interviewer Debriefing 


In December 1994, interviewers received a questionnaire to capture their reactions to and 
experiences with a variety of survey materials and procedures. Included were questions about 
interview scheduling, sampling procedures, working with the FIB and measuring guides, and related 
issues. The Debriefing Questionnaire became the basis for a 1-day in-person debriefing held in 
January 1995. Sixty-five interviewers and the five field supervisors attended the debriefing in San 
Antonio, Texas. The sessions were led by the field supervisors and observed by Westat and ARS 
staff. Attachment 3.J contains the Interviewer Debriefing Questionnaire, showing the tally of responses 
and examples of the interviewers' comments. Attachment 3.K summarizes the In-Person Interviewer 
Debriefing Session. 


Additionally at this meeting, 1 day was devoted to training on the revised 1995 survey 
documents. Eleven interviewers who were unable to attend this session were trained over the 
telephone by their supervisors, using the materials presented at the in-person session. 


3.7 Data Collection Issues 
Diet and Health Knowledge Survey 


Interviewers were required to obtain the supervisor's approval to conduct DHKS 
interviews in-person. Interviewers were to record the reason for the in-person interview on the DHKS 
Call Record with a note that the supervisor had granted permission. The supervisors were instructed 
to generate from the FMS a log of the IDs of DHKS interviews conducted in person and to record the 
reason for approval in the comments section of the log. In the CSFII/DHKS 1994, approximately 65 
percent of the cases were documented in the supervisor logs. To improve the documentation in the 
CSFII/DHKS 1995, the logs have been revised to provide a list each week of any new cases approved 
for in-person conduct. Additionally, the record-keeping requirements have been emphasized with the 
supervisors and interviewers. 
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Validation 


Ten percent of all cases were randomly selected for validation at the time of sample 
selection. The supervisor's log indicated which cases had been selected. This procedure is commonly 
used at Westat to give eligible, ineligible, and nonresponse cases a chance of selection and to spread 
the validation cases fairly evenly across all interviewers. For the CSFII/DHKS 1995, the percentage 
of cases preselected for validation has been increased from the 10 percent required by the contract to 
20 percent. This change was made to increase the chance of selecting eligible cases with SPs and 
Intake interviews. In the CSFII/DHKS 1994, it was difficult to monitor the number of validation cases 
by interviewer because the FMS accepted only one validation result code for each case even though 
more than one interviewer worked on the case and the work of all interviewers was validated. For this 
reason, the FMS validation report understated the number of validations per interviewer. For the 
CSFII/DHKS 1995, a manual system was developed to supplement the FMS and to ensure more 


precise data on the percentage of validation completed for each interviewer. 


Training 
Seven consecutive days of interviewer training is a long time for trainees to continue to 


learn project materials at the required proficiency level. Westat suggests adding 1 day to interviewer 
training so that the interviewers can be given a half-day off in the middle of training. 
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4. DATA PREPARATION AND PROCESSING 


4.1 Overview of Data Preparation and Processing Activities 


The data preparation and processing for the Continuing Survey of Food Intakes by 
Individuals and the Diet and Health Knowledge Survey (CSFII/DHKS) began when completed 
questionnaires arrived at Westat's home office and were receipted into the Forms Tracking System 
(FTS). The FITS was used to monitor each document as it went through the various steps of data 


processing. 


Completed Intake Questionnaires received a quality review to determine whether they met 
the minimum criteria for completeness, to identify missing information, and to record errors that could 
be reported to the interviewer. The food-related items in the Intake Questionnaires were coded by 14 
trained food coders using Survey Net, an automated system provided by the Agricultural Research 
Service, United States Department of Agriculture (ARS, USDA). The non-food items in the Intake 
Questionnaires and the non-Intake documents [i.e., Screeners, Household Questionnaires, DHKS 
Questionnaires, Non-interview Report Forms (NIRFs), and Call Record Folders] were coded, key 
entered, and machine edited using Westat's systems for these processes. Pencils of different colors 
were used to differentiate each manual processing task (red for coders, purple for verifiers, orange for 


machine editors, and green for the receipt clerk). 


All survey documents were completely processed and the last CSFII/DHKS 1994 data 
delivery was prepared for transmission to ARS at the end of February 1995 as required by the 
contract. 


4.2 Revisions to Pilot Study Procedures and Materials for the Main Survey 
The Pilot Study provided valuable experience that was incorporated into changes in the 


procedures and materials for the Main Survey. These updates to the Pilot Study materials and systems 


follow. 
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Machine edits were developed to extensively check consistency within and across 
documents. 


The consistency of demographic information about each sample person (SP) was 
checked between the FTS, the Screener, the Intakes, and the DHKS Questionnaire. 


The Intake Review performed by coders was expanded and the review form was 
automated. 


The FTS was revised to reflect the flow of data from the field for the Main Survey, 
during which the Screener and the Household Questionnaire were routinely 
receipted separately from the Intake Questionnaire. Other changes were made to 
Streamline the system. The FTS was also revised during the CSFII/DHKS 1994 to 
remove unclear fields. 


Adjudication reports for double-coded Survey Net entries were expanded to include 
Outputs for foods that had been coded by one coder but were missed or not coded 
by the second coder. 


A report of Survey Net notepad entries and decisions was enhanced to enable the 
printing of more than one batch of notepad entries at a time. 


The training program for coders was revised to increase the number of trainer-led 
presentations and independently completed Survey Net exercises, and to provide 
feedback from the adjudication reports for all Survey Net exercises. Additionally, 
the sessions on searching for foods and entering quantities were expanded. 


Receipt and Tracking of Documents 


The FTS is an automated system that was developed by Westat for the CSFII/DHKS. 


The system was developed to monitor the progress of documents through every step of data processing 


by recording when and by whom each task was completed. All survey documents, including 
questionnaires, the Call Record Folder, and the NIRF, were tracked through the FTS. Household 
composition, document disposition, and case ID information from the Field Management System 
(FMS) was downloaded into the FTS weekly; during the receipt process, the clerk compared the data 


from the FMS to the hard-copy documents. Discrepancies were resolved by the field director. 
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Documents were receipted and batched at Westat according to the following procedures. 


= The contents of each package were checked against the accompanying transmittal 
sheet completed by the interviewer. 


a Documents were sorted according to document type. Screener and Household 
Questionnaires were kept together because they contained a great deal of 
interrelated information. The Intake Questionnaires for a household were also kept 
together to enhance the efficiency of food coding. 


ra] For non-Intake documents, a General Edit was performed at the time of receipt to 
determine if the document met the minimum criteria defined by ARS. 


a All non-Intake documents that met the requirements of the General Edit were 
receipted into the FTS. If the questionnaire did not meet the minimum criteria, or 
if the review revealed that an SP had been selected in error, documents were held 
for data retrieval or corrective action in the field. (See Section 4.5.2.2 for a 
discussion of the procedures for retrieving missing information.) Examples of the 
General Edit forms for non-Intake documents are included as Attachment 4.A. 


a Intake documents were receipted and kept together in separate batches. They did 
not undergo a review to determine whether they met the minimum criteria at the 
time of receipt. 


2 The receipt clerk also checked to see if a case had been selected for validation. 
Documents associated with validation cases were receipted, sorted, and held until 
all documents relating to the case had been received. Then portions of the 
documents were photocopied and sent with a validation form to the field 
supervisors before further processing occurred. 


= The FTS created batches (work units for the reviewers and coders) of 10 Intake or 
20 non-Intake documents. The system also generated a Batch Control Form, which 
listed the IDs in the batch and traveled with the documents. 


After batching, Intake and non-Intake documents were routed differently through data 
processing. Through early May, four trained food coders also coded the non-Intake documents. 
Beginning in mid-May, the non-Intake documents were coded by staff members responsible for coding 
only non-Intake documents. After coding, the non-Intake documents were verified, keyed, and 
machine edited. The Intake instruments were assigned to trained food coders, and the coder's ID and 
the batch number were recorded in the FTS. The food coders first reviewed the questionnaires and 
then used Survey Net to code the Intakes. After the Intakes had been coded, they were verified, 
adjudicated, key entered, and machine edited. 


The FTS produced daily and weekly reports. The daily report was simply a snapshot of 
the FTS files, whereas the weekly reports were more thorough. The weekly reports detailed the 
number and disposition of each document received, the number of documents in each processing step, 
the status and results of quality control operations (i.e., Survey Net verification), response rates by 
PSU and income level (non-low or low) and interviewer, and the percentage of Intake Interviews 
completed on each day of the week. The daily snapshot and the weekly report were transmitted 
electronically to ARS. 


4.4 Recruiting and Training Data Preparation Staff 


In January 1994, 16 coders were recruited to review and code the Intake Questionnaires. 
Applicants went through a multistage recruiting process that included completing a Screener with 
questions about experience in purchasing and preparing food (a contractual requirement); relevant 
experience and education; a short exercise on using Survey Net on the computer, selecting food codes, 
and entering food quantities; and an in-person interview. 


Coders began their training by attending 5 days of the in-person field supervisor training 
session in December 1994. Topics addressed during the 5 days included an introduction to the survey, 
all of the presentations on the Intake Questionnaire, and the introductory presentations on the non- 
Intake documents. Coders were also required to complete the interviewer Home Study Guide before 
attending coder-specific training. The interviewer Home Study Guide provided an introduction to the 
Food Instruction Booklet (FIB), the main tool the interviewers used to probe for food detail and 
quantities on the Intake Questionnaires and the main tool the coders used to review the Intakes before 
coding. Before the in-person coder training began, two of the recruits resigned to accept other job 
offers. 


In a 9-day session beginning on January 11, the 14 food coders were trained at Westat. 
The training focused on teaching the Survey Net coding system. The coders were also trained to 
complete the three-stage review of Intake Questionnaires using an automated Intake Review and to code 
the non-food questions on the Intake Questionnaires. The training agenda is included as Attachment 
4.B. 


At training, the food coders were given numerous materials that they would need to 
perform their jobs. These included the coder manual, General Instructions for Reviewing and Coding 
Food Intake Questions, which contained sections on all topics covered in the training and screen-by- 
screen instructions for the Intake Review and Survey Net coding. The coders were also given ARS's 
Food Coding Guidelines, codebooks for the non-food questions on the Intake Questionnaires, and 
numerous coder aids, such as laminated copies of the lists of combination codes and definitions and 
eating occasion codes. 


During Survey Net training, the trainer used lectures, demonstrations, a tutorial, and 
exercises to introduce material to the trainees. Exercises were presented in hard-copy and 
computerized formats and increased in complexity as the trainees became more comfortable with the 
Survey Net software. The training approach provided the coders with extensive hands-on practice with 
Survey Net. All computer-based presentations were facilitated through the use of a data display, which 
projected the trainer's entries onto a large screen and helped the trainees to keep pace with the 
presentation. Throughout Survey Net training, the coders received feedback on their exercises. The 
coders' entries were compared to the correct entries and the trainer reviewed discrepancies on a hard- 
copy list, identified coding errors, and provided the coders with feedback. 


The food coders were also trained to manually code the non-food questions on the Intake 
Questionnaires. Manual coding included correcting interviewer errors, zero-filling designated fields to 
be skipped, entering codes for "don't know" and "refused" responses, and translating marginal notes 


into codes. 


Before completing the training and being certified to begin coding, the coders were 
required to use Survey Net to code a final test set of three Intakes provided by ARS. Coders had to 
have fewer than five errors on each Intake to satisfactorily complete the test sets. Eleven of the 14 
trainees were certified to code on Survey Net after their initial entry of the test Intakes. The three 
remaining trainees were certified after their second attempt. By January 28, all 14 coders had 
successfully completed the training and were certified to perform Survey Net coding. 


After training and certification, food coders practiced their newly acquired skills by 


reviewing and coding practice interviews completed by the interviewers. By the beginning of February 


1994, the coders were processing Main Survey Intake Questionnaires. 
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Food coders periodically received refresher training on Survey Net and the Intake 
Review. Survey Net retraining included searching for foods, entering quantities, and modifying 
recipes. Intake Review retraining emphasized strategies for improving the efficiency and effectiveness 


of the review. 


Two food coders left the project during the year. One coder left to become a full-time 
student in June and a second coder was reassigned in September because of productivity problems. 


Training materials for non-Intake coder training included the manual General Instructions 
for Reviewing and Coding Non-Intake Questions, codebooks for each non-Intake document, and 
training exercises. The manual contained an introduction to non-Intake data collection, the data flow, 
the General Edit, and Westat's coding conventions. The codebooks included file layouts, precodes, 
special notes to coders, and logics used in machine editing. Training exercises were scripted to 
incorporate examples of many of the data problems the coders would encounter. The Non-Intake 
Coder Training Agenda is included as Attachment 4.C. 


Four of the 14 food coders were also selected to code non-Intake documents. In a 4-day 
session beginning on February 10, these coders were trained to code and machine edit the Screener 
Questionnaire, the Household Questionnaire, the Household Folder, and the NIRF. On March 10, the 
coders were trained to code the DHKS Questionnaire, the DHKS Folder, and the DHKS NIRF. In 
mid-May, to expedite the delivery of Intake documents to ARS, all trained food coders were assigned 
exclusively to Survey Net coding. Four new non-Intake coders were recruited and trained using the 
original materials and methods. By August, with the backlog of unprocessed documents diminished, 
only two non-Intake coders were required. 


4.5 Processing Intake Questionnaires 
4.5.1 Introduction 

Within 2 days of an Intake's receipt at Westat, the coders performed an Intake Review. 
The results of the review were summarized and reported to the field supervisors and the interviewers 


as needed. If an Intake was missing critical information, data retrieval was conducted in an attempt to 
obtain the information. 


Ten percent.of Intakes were verified by having a second coder independently enter the 
information into Survey Net. The two entries were compared using adjudication reports developed by 
Westat, and the results were used to provide the coders with feedback. Throughout the year, coder 
error rates were 0.4 percent. The Survey Net system has a feature that allowed coders to enter 
comments and questions into a "notepad" file. The coding supervisors reviewed notepad entries for 
each Intake and provided feedback when necessary. The supervisors also reviewed all unknown foods, 
foods not available in Survey Net, and recipes that the coders modified. 


The non-food questions on the Intake Questionnaires were manually coded, verified by 
having a second coder check the accuracy of each coded response, key entered using the Tartan data 
entry system, and machine edited using programs developed with Westat's COED software. Survey 
Net data, non-food data, and the hard-copy Intake Questionnaires were delivered to ARS weekly. 


Figure 4-1 illustrates the data flow and processing steps for Intake data. 


4.5.2 Intake Review 


4.5.2.1 Introduction to the Review Process 


Thorough procedures were developed to monitor the quality of the Intake data and to 
provide the interviewers with timely feedback. The in-house review process for the Main Survey 
evolved from the procedures used on the Pilot Study. Whereas a two-stage process was used during 
the Pilot Study, the review and coding of Intakes were performed concurrently by the same coder 
during the Main Survey. Also, the review was automated to decrease the time required to complete the 
review and produce a document that would provide detailed feedback to the field staff and summary 
information on the quality of each interviewer's work. Exhibit 4-1 shows a completed computerized 
Intake Review form. 
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Figure 4-1. Data flow and processing steps for Intake data 
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Exhibit 4-1. Screen from the automated Intake Review 


INTAKE REVIEW PAGE NO.: 


Household+Sp id+Intake(1 or 2): 2071141129 - 02 - 2 


PART 1 - INTAKE MINIMUM CRITERIA 


Interviewer Initials: KAY Date of Review: O6DEC1994 

Coder/Reviewer ID : 005 Batch Number : 2991 
Total Number of Food Items in Food/Drink Column : 14 

1. Number of Food Items with NO Description 20.0 0% 

2. Number of Food Items with NO Amount : 0 0% 


3. Meals reported by the SP with NO Foods/Amounts? : N 


Did Intake meet minimum criteria? siny, 


Reason(s) Intake did NOT meet min criteria sue ees 


PART 2 - DETAILED MISSING FOOD INFORMATION 


Line # Missing Food Missing Detail 
5 Apple Small, medium or large apple? 
6 Bread on pb sandwich Regular, thick or thin slices? 
12 Ice cream Anything added to ice cream? 


GENERAL COMMENTS ABOUT THE INTAKE: It looks as though you used the FIB well for most foods. Good job. 


PART 3 - GENERAL INTERVIEWER ERRORS 


No editing marks on the Intake ----------+------ oor rrr r ncn >: 
Combination is not bracketed ---------------------r orton >: 
Eating occasion is blank --------------rr nnn nner errr rrr >: 
Time of eating occasion is blank ------------------ 07 rrr rrr >: 
AM/PM is not circled for time of eating occasion ------------- >: 
Data Retrieval is incorrectly recorded. ------------------777- >: 
Writing is difficult to read ------------------------- 89 n no >: 
Not enough space used to record descriptions ----------------- >: 
Quick List - No underline after first pass -----------------7" >: 
Quick List - Items are not transferred to Food/Drink column --> : 
Reference to another food item is unclear -------------------- >: 
Nothing Else - is not written at the end of the Intake ------- Sirs 
Skip pattern(s) incorrect for Q: 

Interviewer observation incomplete. -----------esrrrrr rrr rrr >: 
Other: 


The review of each Intake included three parts: 


1. An edit to determine whether the Intake met ARS's minimum criteria for 
completeness; 
2. A line-by-line review of the description and quantities collected about each 


reported food; and 


oF A check for general interviewer errors in recording. 


4.5.2.2 Minimum Criteria for Intakes 


To be considered complete, an Intake had to include the following: 


1. Sample descriptive data (i.e., segment identification and housing unit identifiers); 


Py The SP's first name or other suitable designation and his or her person 
identification number; 


3; The SP's age or date of birth; 
4, The date and day of the week on which the Intake interview was conducted; 


Ay At least one food or beverage for each eating occasion reported by the SP [i.e., if 
the food record indicated an eating occasion but did not list the food(s) or 
beverage(s) consumed, the Intake would not be considered complete]; 


6. Sufficient detail to permit coding for at least 75 percent of the reported foods; and 


7E Information on quantity consumed for at least 85 percent of the reported foods. 


Of the 10,912 CSFII 1994 Intake Questionnaires delivered to ARS, only 12 did not meet 
the minimum criteria. Of these, one Intake Questionnaire was considered incomplete because more 
than 25 percent of the reported foods were described in inadequate detail. Two Intakes were 
unacceptable because more than 15 percent of the reported food items were missing amounts 
consumed. Nine Intake Questionnaires did not meet the minimum criteria because no food(s) or 
beverage(s) was reported for an eating occasion. 
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Initially, approximately 100 Intakes were determined not to meet minimum criteria when 
they were reviewed at Westat. Because Intake Questionnaires are reviewed within 2 days of receipt, 
data retrieval from the interviewer or the SP was possible while the interview was still relatively fresh 
in their minds. For example, if an Intake was missing a description of a meal eaten away from home 
by a young child, the coder called the daycare or other source identified on the Household Folder Call 
Record. Or, if the quantity and/or descriptive information was missing, the coder called the SP in an 
attempt to retrieve the information. Although in-house data retrieval efforts were largely successful, 
12 Intakes still did not meet the minimum criteria after data retrieval! The main reasons were as 


follows: 


Ee Older SPs could not remember what they ate; 


Bey The information could not be obtained from the daycare provider or school (i.e., 
the parent refused to give consent to call the daycare or school, the daycare or 
school refused to provide the information, the SP or daycare had no telephone, or 
the daycare or school no longer had the meal information); and 


3. The SP had moved and could not be located. 


Table 4-1 illustrates the demographics of SPs whose questionnaires did not meet the 
minimum criteria. The ability of children aged 6 to 11 years to report for themselves in the presence 
of a parent was of particular interest to ARS because the data for this age group were collected by 
proxy in previous surveys. During the CSFII 1994, only one questionnaire for a 6- to 11-year-old SP 


failed to meet the minimum criteria. 


1 Twelve additional Day 1 Intake questionnaires did not meet minimum criteria. With the agreement of both Westat and ARS, complete Day 
2 Intake data provided by these 12 SPs were substituted for the incomplete Day 1 data and the Day 1 Intake was considered complete and 
meeting minimum criteria. The Day 2 Intake received a unique nonresponse disposition code (disposition code F25). 
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Table 4-1. Demographics of SPs whose Day 1 and Day 2 Intake Questionnaires did not meet 
minimum criteria (n = 12) 


Total 

Demographics Day 1 Day 2 N % 
Age 

<6 years Z 5 7 58.4 

6-11 years 0 1 1 8.3 

> 11 years 2 2 4 833 
Total 4 8 12 100.0 
Sex 

Male 4 11 Oly 

Female 0 1 1 8.3 
Total 4 8 12 100.0 


4.5.2.3 Missing Detail for Food Items 


Interviewers were trained to use the probes in the FIB to obtain the necessary detail for 
each reported food. The probes included very specific information about the food, such as the 
preparation method, quantity, type of fat used, brand, dilution, and whether or not salt was added. If 
the SP could not answer a probe, the interviewer was required to document the response as a “don't 
know" (D.K.) on the Intake. The coder used the FIB to perform a line-by-line review of each reported 
food item. On the Review Form, the coder noted the line number, food type, and any missing probes. 
Exhibit 4-2 is a page on cooked cereals from the FIB to illustrate the detailed probes required when 
reporting foods. 


By reviewing the results of the first quarter of Intakes, Westat attempted to develop a 
measure of quality on the level of missing detail that still permitted adequate coding of most foods 
using the most specific code and quantity available in Survey Net. The conclusion was that 20 percent 
or less missing detail still allowed for high-quality coding. 


Exhibit 4-3 is an example of an Intake with 20 percent missing detail. On line 5, the 
amount of apple consumed is reported as "1," but the FIB probe for amount is "Was it small, medium, 
or large?" Although "1 apple" can be coded in Survey Net, the interviewer should have asked the 
probe specified in the FIB. If the SP could not answer the FIB probe, the interviewer should have 
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Food/Drink 
Category 


Cooked Cereals 


Exhibit 4-2. Sample page from the Food Instruction Booklet 


CEREALS, PASTA, RICE 


Q4. 
Description of Food/Drink 


KIND: What kind was it? (Was it oatmeal, cream of 
wheat, cornmeal mush, grits, kasha, whole wheat...?) 


BRAND: What was the brand name? 


TYPE: Was it regular-cooking, instant, or quick? 
If instant -- Was it plain or flavored? 


PREPARATION: How was it prepared? 
Liquid: Was it made with milk, water...? 
If prepared with milk — Was the milk whole, 
lowfat (1%, 2%), skim...? 


Salt: Was salt used in cooking or preparing the 
(FOOD)? (DK SALT, NO SALT, SALT USED) 


Fat: Was any kind of fat or oil used in cooking or 
preparing the (FOOD)? (DK FAT, NO FAT, FAT USED) 
If fat used -- What kind? 


Other ingredients: Was anything else added in 
cooking? 
If yes - What was it? 


ADDITIONS: Did you add anything to the (FOOD)? 
RECORD EACH ADDITION ON A SEPARATE LINE IN THE 
FOOD/DRINK COLUMN, COMPLETE Q5 FOR THE ORIGINAL 
FOOD, AND THEN ASK Q4 AND Q5 FOR EACH ADDITION. 
Examples: Milk or cream, pages 6, 8 

Sugar or sugar substitute, page 20 

Fruit, page 31 

Butter, margarine, page 77 
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Q5. 
How much of this (FOOD) 
did you actually (eat/drink)? 


IF VOLUME: How much? 


(Tsp, Tbsp, Cup) 
(SPECIFY DRY OR COOKED) 


IF WEIGHT: What was the 

package weight and portion 

eaten? (DRY ONLY) 
(Example: 1/2 of 3/4 WO 
package) 


Exhibit 4-3. Intake with 20 percent missing detail 
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written "D.K. size," to indicate that the SP was unable to answer the probe. This notation was the 
only means by which the-reviewer could verify that the interviewer had asked the probe. On line 6, 
the amount of bread in the sandwich is documented as "2 sl." The probe in the FIB for the amount 
asks for the number and size of the slices. Again, the amount can be coded but not to a specific 
enough level. On line 12, the FIB requires a probe for additions to ice cream. If the SP had reported 
no additions to the ice cream, the interviewer should have written "no adds." Note that the food and 
quantity descriptions in Survey Net have varying levels of specificity. If a food is not completely 
described, the coder can assign a default code or amount that represents the value of only the 
information actually reported. 


The interviewers demonstrated consistent improvement in the quality of Intake data 
collected. Figure 4-2 shows that the percentage of interviewers with less than 20 percent missing 
detail on their Intakes has increased from 50 percent in Quarter 1 to 78 percent in Quarter 4. 


Also, as shown in Figure 4-3, the average percentage of missing detail on the Intakes has 
declined consistently each quarter, from 21 percent in Quarter 1 to 19 percent in Quarter 2, 18 percent 
in Quarter 3, and only 14 percent in Quarter 4. The two most common missing details in the CSFII 
1994 were portion size and additions to food. 


4.5.2.4 General Interviewer Errors 


In addition to providing an insufficient description of reported foods, interviewers could 
make other types of errors. To accommodate the documentation of these other errors, the Review 
Form listed the 14 most common types of mistakes discovered on the Pilot Study. 


A way of looking at interviewer performance is to examine the average number of errors 
per Intake. The results shown in Figure 4-4 indicate that the average number of errors per Intake 
declined from 1.6 in Quarter 1 to 1.5, 1.4, and 1.1 in Quarters 2, 3, and 4, respectively. The three 
most common mistakes made by the interviewers on the CSFII 1994 are described below. These three 
errors account for 64 percent of the total errors made during the CSFII/DHKS 1994. 


1. No edit. During the review, it was apparent that the interviewer failed to carefully 
edit the completed Intake. This increases the likelihood of errors. 
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Pb, Combination not bracketed. The interviewers were to bracket foods eaten as a 
combination. For example, if the interviewer reports 1 cup of coffee on the first 
line of the Intake Questionnaire and 1 tablespoon of milk on the second, but does 
not bracket these food items, a coder will not know whether to code them 
separately or as a combination. This results in a loss of some information about 
foods consumed together. 


3. am/pm not recorded. Interviewers were required to record the time that the food 
was consumed, and they frequently failed to note whether it was am or pm. 


As Figure 4-5 shows, the number of Intakes affected by the three most common 
interviewer errors decreased throughout the year. The largest reduction was in the "no edit" error 
type, which affected 3 of every 10 Intakes in Quarter 1 but less than 1 of every 10 Intakes in Quarter 
4. 


4.5.2.5 Feedback to the Field Staff 


During the first quarter of data collection, the results of the review were sent to the field 
supervisors and the interviewers for every completed Intake Questionnaire. If an identified problem 
required immediate attention, an E-mail was sent to the supervisor and the interviewer. A photocopy 
of the completed questionnaire was also sent to the interviewer if it was necessary to illustrate the 


error. 


After the first quarter of data collection, review forms were sent to the interviewer if the 
level of missing detail exceeded 20 percent and/or if the interviewer made three or more general 
errors. When new interviewers joined the survey, they received the review forms for all of their 
Intakes for their first quarter of work. If an interviewer's work was satisfactory, the review forms for 


subsequent quarters were printed out according to the guidelines specified above. 


The automated review system also produced a series of reports by interviewer that helped 
Westat to monitor the quality of each interviewer's work. One type of report showed the percentage of 
missing detail across all Intakes completed by an interviewer (see Attachment 4.D). The percentage of 
missing detail was calculated on the number of foods missing any detail, divided by the number of 
foods reported for an Intake. A summary report by interviewer was produced each week and was 
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reviewed by the field director before being sent to the supervisors. Also, a summary report showing 
general errors by interviewer was produced each month during Quarter 4 (see Attachment 4.E). The 
summary reports helped to indicate when interviewer retraining was needed and to identify issues 


requiring discussion in a newsletter or a memo to the interviewers. 
4.5.3 Survey Net Coding of Intakes 
4.5.3.1 Introduction 
Food coding was accomplished using the Survey Net system. The system had many 


advantages over the hard-copy USDA Code Manual that was used on previous ARS food consumption 


surveys. The system included the following major features: 


@ Automated access to a very large food database and its component parts, including 
food and gram-weight descriptions and a recipe file; 


= Searching capabilities that locate suitable food codes quickly and easily; 
= Fast and accurate automated conversion of quantity information to gram-weight 
equivalents; 


= The flexibility to change ingredients in standard recipes; 


a A "copy" feature that allowed coders to copy foods within an Intake (for foods that 
an SP ate more than once) or between Intakes (for foods that were eaten by more 
than one SP in a household); 


= The "unknown" feature, which allowed coders to enter food descriptions not 
available in the database and enabled other coders to use these descriptions; and 


a Documentation of the decision-making process through a notepad feature, which 
enhanced communication between coders, supervisors, and ARS. 


ARS updated Survey Net several times during the CSFII 1994 to add system 
enhancements, incorporate new food information, and resolve unknown foods and recipe 
modifications. During the course of the year, three system enhancements were made to Survey Net to 
improve the efficiency and effectiveness of the coding operation. The food database was upgraded six 
times to incorporate additions such as new foods, weights, and nutrient information. Fifty-two weekly 
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food database updates were made that provided resolution about unknown foods and recipe 


modifications. 


The system enhancements and database upgrades were accomplished during the coders’ 
lunch time and took less than a half-hour. The weekly updates were performed after the weekly 
delivery to ARS and required approximately a half-hour. The coders could continue processing Intakes 
immediately after the updates, and Intake processing continued without interruption. The system's 
flexibility and the ease with which it could be updated were significant benefits to Westat. 


4.5.3.2 Number of Food Items Per Intake 


There are three different measures collected in the CSFII 1994-96 concerning the number 
of food items captured on an Intake Questionnaire: 


1. The number of foods reported "above the line" on the Quick List, 
De The number of foods reported in the Food/Drink and Additions column, and 


a The number of foods coded in Survey Net. 


Measures 1 and 2 above are based on what is reported by the SP. The foods “above the 
line" on the Quick List represent what the SPs reported on the first pass through the Intake. In the 
first pass, the interviewer asked the SPs to report a list of all foods eaten the previous day using any 
recall strategy they desire. The interviewer then got a more detailed list of foods by probing for 
additions, such as cream in coffee, giving the SPs an opportunity to recall food items they initially 
forgot. In the third and final pass, the interviewer reviewed with the SPs the list of foods reported to 
elicit more foods and eating occasions not previously mentioned. The number of foods reported in the 
Food/Drink and Additions column includes foods from the Quick List as well as those reported during 
more detailed probing in the second and third passes through the Intake. 


The third measure, the number of foods coded in Survey Net, varies somewhat from what 
the SPs report. Some foods reported as a single item are coded as more than one food in Survey Net. 
For example, a sandwich may be reported as a single food in the Food/Drink and Additions column of 
the Intake; however, depending on the amount of detailed information obtained about the sandwich 
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(i.e., type and amount of bread and filling), the sandwich may be coded with a single sandwich code or 
with separate codes for each ingredient. 


The average numbers of reported and coded foods per Intake are listed in Table 4-2. 


Table 4-2. Average number of food items per Intake 


Reported on Reported in Food/Drink 
Intake Quick List and Additions Column Coded in Survey Net 
Day 1 9.4 12.2. 14.0 
Day 2 9.3 11.8 13.5 


4.5.3.3 Coding and Processing Times for Intakes 


As shown in Table 4-3, Westat began the CSFII/DHKS contract with an estimate of 56 
minutes to review and code an Intake Questionnaire and 17 minutes to perform postcoding activities, 
including Survey Net notepad review, verification and adjudication, and machine editing. Because 
Survey Net was a newly developed system that had not been used in full-scale production before the 
start of the CSFII 1994, ARS provided the estimated time based on its own testing experience. 


In the Pilot Study, the average time required to review and code an Intake was 71 
minutes. There was no estimate for postcoding activities because the coding supervisor had performed 
these activities along with her other responsibilities. In preparing the staffing plan for the Main 
Survey, Westat used the Pilot Study experience of 71 minutes to review and code an Intake, plus the 
original estimate of 17 minutes per Intake for postcoding activities. Although it was estimated that 300 
hours per week of coder time would be needed to process the Intakes on schedule, Westat trained a 
staff that would provide 400 hours. This conservative estimate was intended to ensure that Westat 
would be able to review the Intakes within 2 days and deliver the data to ARS within 30 days of 
receipt at Westat, as required by ARS. 
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Table 4-3. Average number of minutes to process Intake Questionnaires 


Original CSFII 1994 
contract Pilot Intakes in 
estimate Study first 4 months All Intakes 
Review and 56 7A 88 59 
coding 
Postcoding* 17 —f 23 30 
Total time 73 111 89 


‘4 Includes notepad review, verification and adjudication, and machine editing. 


T Because the scope of the Pilot Study was small, the coding supervisor completed these tasks along with other responsibilities. Therefore, it 
is not possible to provide a separate estimate for postcoding activities. 


As Table 4-3 indicates, in the first 4 months of processing, the average times to review 
and code an Intake (88 minutes) and to perform postcoding activities (23 minutes) were considerably 
higher than the estimates used to develop the staffing plan. Beginning in late March, the average 
number of days required to process an Intake after receipt at Westat exceeded 30 days. By early May, 
and after having lost one coder, the backlog of unprocessed Intake Questionnaires was considerable. 


At that time, Westat and ARS developed a plan to expedite processing and reduce the 
backlog. The plan included having a separate supervisor and coders to process non-Intake documents, 
which would allow trained food coders to work exclusively on Intakes. In addition, Westat planned to 
increase the time spent with each coder to discuss productivity goals and ways to improve 
performance. The coding supervisor also attempted to answer all coding questions as quickly as 
possible. ARS agreed to observe the coding operation and to recommend ways of improving the 
efficiency of Survey Net. 


On the basis of these observations, ARS made several helpful suggestions. The major 
recommendation was that Westat retrain the coders to perform Survey Net word searches. Additional 
recommendations included streamlining Survey Net notepad entry procedures, providing refresher 
training on calculations, and re-evaluating the day-to-day logistics of the coding operation, such as the 
assignment of coding batches, coder seating arrangements, the use of aids such as rulers, changes in 
the order of case review and entry, and variations in the tasks performed during the day. 
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Figure 4-6 shows that the average coder times for reviewing and coding Intakes improved 
considerably in June. As shown in Figure 4-7, in June the average Intake processing time also 
dropped below 30 days from receipt at Westat. These improvements were attributed to the individual 
meetings with coders; the presence of ARS, which heightened the coders' awareness of the importance 
of increasing production; ARS's and Westat's suggestions for increasing coding efficiency; the coders’ 


continually growing experience; and an increase in the number of supervisory staff. 


Westat and ARS cooperative efforts improved the processing time considerably. As 
shown in Table 4-3, the average time to review and code all Intakes in the CSFII 1994 was 59 minutes 
and the postcoding time averaged 30 minutes. The postcoding time increased from the time 
experienced in the first 4 months because of the addition of special machine edits. Some of the 
additional edits were to ensure consistency across documents; to verify that the correct household 
members were sampled; to check age and sex across all documents; and to check age, sex, and 


Screener line letters for household members listed in the Household Questionnaire grids. 


As Figure 4-7 shows, Westat continued to meet the turnaround time for processing 
Intakes from June through most of November 1994. In the last week of November, the number of 
available coding hours decreased because one coder was released and others reduced their hours during 
the holiday season. In addition, the number of Intake Questionnaires received at Westat increased 
because interviewers were working hard to complete their assignments before the end of the year. 
These circumstances resulted in a backlog of Intakes and a turnaround time of more than 30 days 
between receipt and delivery to ARS. Throughout this period, however, Intakes were reviewed within 
2 days of receipt at Westat. 


In January 1995, the coders were asked to work additional hours, and Westat trained and 
certified another three food coders. By mid-February 1995, the time required to process Intakes was 


again averaging no more than 30 days from receipt to delivery. 


Table 4-4 shows the average number of calendar days to move Intake Questionnaires 
through each processing step and the overall processing time, which is the average number of days 
between an Intake's receipt at Westat and its transmission to ARS, including time elapsed for all 
processing steps. As a result of the circumstances described above, the time between Intake receipt 
and delivery to ARS averaged 33 days for the CSFII 1994. The contractual requirement to process and 
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transmit all 1994 data by February 28, 1995, was met. However, at the request of ARS, the final 
delivery was postponed 5 weeks because of the ARS office relocation. The processing steps shown in 
this table are described briefly below. 


a Reviewing and Survey Net entry. Documents were reviewed to ensure that they 
met ARS'‘s minimum criteria, and field staff feedback and entries were made into 
Survey Net. Non-food sections of the Intake Questionnaires were prepared for 
production keying. 


z Verification and double entry. For 10 percent of the Intakes, a second coder re- 
entered the intake data into Survey Net and reviewed the manually coded portions 
of the document. 


wi Survey Net adjudication. The supervisor and senior coders reviewed a report 
comparing the two sets of Survey Net entries, corrected entries if necessary, and 
tabulated the number of coder errors. In addition, the supervisor reviewed 100 
percent of the Intakes in Survey Net for notepad entries, newly modified recipes, 
and unknown foods. (Attachment 4.F contains the shell of the Survey Net 
adjudication report.) 


a Data entry. Non-food data on the Intakes were keyed in a production data entry 
environment. 


a Machine edit. Non-food data on the Intakes were cleaned with machine-editing 
programs. 


= Transmittal to ARS. Data were electronically transmitted to ARS once a week. 


Table 4-4. Average elapsed time (days) for processing Day 1 and Day 2 Intakes 


Processing step Days to process 
Reviewing and Survey Net entry 12 
Verification and double entry 3 

Survey Net adjudication 6 

Data entry 5 
Machine edit 5 
Transmittal to ARS 2 
Overall processing time = |= = = 33 | 
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4.5.3.4 Quality Control of Survey Net Coding 


To verify food coding, 10 percent of the coded Intakes were re-entered into Survey Net 
by a second coder. A report comparing the two versions was used by the coding supervisor to 
adjudicate the discrepancies. The results of the adjudication process were entered into the FTS, and 
reports of error rates by coder were generated. 


Two separate error rates were calculated for the Survey Net entries: an error rate for the 
food data and another for the cover sheet data (information such as SP identification number and age, 
interviewer name, and date of interview). Both error rates were calculated by dividing the number of 
fields with erroneous entries by the total number of fields. (Definitions of the fields used to determine 
the error rates appear in Attachment 4.G.) 


As shown in Table 4-5, the error rates were extremely low, with Intake cover sheet errors 
and Survey Net coding errors averaging 0.3 percent and 0.4 percent, respectively. Discrepancy 
reports and error rates were regularly reviewed with individual coders and at biweekly meetings where 
all questions and problems were discussed. All notepad entries, modified recipes, and unknown food 


entries were also reviewed and corrected by the supervisor. 


ARS reviewed all Intakes with notepad entries, unknown foods or weights, and recipe 
modifications. All entries were reviewed on 10 percent of the Intakes. ARS provided regular written 
feedback to the data preparation manager. The feedback forms from ARS contained comments on 
coder errors for each batch of Intakes reviewed. The batches were identified by coder ID, and coder- 
specific comments were given to the appropriate coder for reference. The sets of comments were 
compiled in a notebook for review by all coders. Comments from ARS's feedback forms were often a 
source of agenda items for the coder meetings, which ARS attended periodically throughout the year. 


Table 4-5. Survey Net coder error rates 


Coder error rate 


(%_of fields with errors) 


Intake Cover sheet data Food data 
Day 1 0.3 0.4 
Day 2 0.3 0.4 
Total 0.3 0.4 


PG $$ 
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4.6 Processing Non-Intake Documents 


4.6.1 Processing Steps 


Non-Intake documents (the Screener, Household Questionnaire, DHKS Questionnaire, 
Household Folder, NIRF, DHKS Folder, and DHKS NIRF) followed a slightly different processing 
path than Intake documents. Figure 4-8 shows the data flow and processing steps for non-Intake data. 
At receipt, non-Intake documents underwent a General Edit to determine whether the document met 
ARS's minimum criteria for completeness. The document was then either entered into the FTS (if it 


satisfied the minimum criteria) or held for problem resolution (if it did not meet the criteria). 


Reviewed and receipted documents that were flagged for validation were photocopied and 
sent to the field supervisors, who conducted the validation interviews. Documents proceeded to 
manual coding, and 10 percent underwent coding verification. Coded documents were then sent to 
Westat's data entry shop for key entry. Keyed data were machine edited until they were completely 
cleaned and ready for delivery to ARS. 


4.6.2 Review of Non-Intake Documents 
The General Edit determined whether a non-Intake document met the minimum criteria 


established by ARS. To be considered complete, each document had to include the following 
information: 


Screener/Household Questionnaire 


1. Sample descriptive data (i.e., segment identification and housing unit identifiers); 
2s For participating households, income information from the Screener (if necessary); 
3. Complete information on the household enumeration; 


4. The date of the interview; 
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Figure 4-8. Data flow and processing steps for non-Intake data 
General Edit 
(Receipt Clerk) 


Minimum Criteria 
(Receipt Clerk) 


Does Not Meet 
ARS Criteria 


PROCESSING STEPS 
1. GENERAL EDIT 


Peek e CRIP? 
3. VALIDATION 


Meets ARS 
Criteria 


Validation 
(if required) 
(Field Supervisor) 


Receipt 
(Receipt Clerk) 


Prepare and Code Questionnaires 


4. PREPARE AND CODE (Coder) 


5. VERIFY CODING 


6. DATA RETRIEVAL Data Items Missing 


Verify Coding 


Data Retrieval 
(if required) 
(Coder) 


(Coder/ Supervisor) 


Key Entry 
7. KEY ENTRY (Production Data Entry 
8. MACHINE EDITING Operators) 


Machine Editing 
(Coder) 


9. TRANSMITTAL Transmittal to ARS 


= A response to the Screener question concerning the number of people in the 
household; and 


6. A sufficient level of detail to permit the coding of at least 85 percent of the 
appropriate questions. 


DHKS Questionnaire 


1. Sample descriptive data (i.e., segment identification and housing unit identifiers); 
2. The SP's first name or another suitable designation; and 


3. A sufficient level of detail to permit the coding of at least 85 percent of the 
appropriate questions. 


Household and DHKS Folders 


Ly The results, date, and time of each contact attempt (including the interview date 
and time). 


The General Edit of the Screener also included a review of whether the SP was selected 
properly. If an SP had been selected in error, the field supervisor and the interviewer were notified by 
E-mail and corrective action was taken if possible. If the Screener failed to meet the minimum criteria, 
a coder attempted data retrieval with the interviewer. Approximately 2.5 percent of all non-Intake 
documents required data retrieval. Ninety-eight percent of the data retrieval attempts for those 
documents were successful. The General Edit forms are included in Attachment 4.A. 


4.6.3 Processing of Non-Intake Documents 


Processing of non-Intake documents included manual coding and data entry in Westat's 
production data entry shop. Manual coding involved reviewing interviewer entries in the completed 
documents and preparing them for data entry. This coding included correcting interviewer errors, zero- 
filling, designating fields to be skipped, entering codes for "don't know" and "refused" responses, and 
translating marginal notes into codes. Ten percent of the manual coding of non-Intake documents was 
verified through dependent review (i.e., by having a second coder visually review the manual coding 
and identify errors). 
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The non-Intake documents were then key entered using programs developed with the 
Tartan system of data entry hardware and software. Data entry into the Tartan system was 100 percent 
verified through a second entry by a different operator. 


After the non-Intake items had been entered, the data were machine edited using programs 
developed with COED, a Westat software system for cleaning survey data. COED was first used to 
create a codebook that included the file layouts, acceptable codes for each field, skip pattern 
Specifications, and special editing instructions for use in manual coding. The source code for the 
codebook was then used to generate machine-editing programs, which verified that keyed data were 
within the acceptable ranges for a particular field and that skip patterns had been followed correctly. 
An extensive set of special programs were also written to check the relationships between the FTS and 
COED data and between COED data sets (for the non-Intake documents) or between the FTS and 
Survey Net data (for the Intake documents). For example, a program was written to check that the 
FTS disposition code for each document matched what was in the COED records. An additional check 
compared information in the Household Questionnaire and the Screener to ensure that individuals 
eligible for school breakfast and lunch programs were 5 to 18 years old. When discrepant data had 
been resolved, the data were delivered to ARS. Non-Intake data were electronically transmitted to 
ARS once a week. 


The quality of non-Intake coding improved throughout the survey year. Verifiers and 
machine editors gave the coders direct feedback on their errors. In addition, regular coder meetings 
were held to discuss coding decisions, code changes, and feedback from ARS's review of the data. 


4.6.4 Coding and Processing Times for Non-Intake Documents 


Coders documented the number of hours they worked each day and the number of non- 
Intake documents they reviewed and coded. At the beginning of the survey year, the coding of a non- 
Intake document required an average of 7 minutes. The processing time continued to decline, and by 
October, the average time to review and code a non-Intake document was 3 minutes. The non-Intake 
documents were delivered to ARS within 30 days of their receipt at Westat. 
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Table 4-6 shows that the average number of calendar days required to move the non- 
Intake documents through all processing steps ranged from 24 to 27 days. The processing steps shown 
in this table are described briefly below. 


z Coding. Coding consisted of manually writing into the questionnaire or form the 
codes or data that were to be key entered. 


c Coding verification. Verification was the process of coders dependently 
reviewing, correcting, and noting errors in each other's work. (Adjudication is not 
required with dependent verification.) 


= Data entry. Data were keyed in a production data entry environment. 
= Machine edit. Keyed data were cleaned with separate machine-editing programs. 


a Transmittal to ARS. Data were transmitted electronically to ARS once a week. 
Hard-copy documents matched to the electronic data were delivered to ARS on the 
same day. 


Table 4-6. Average elapsed time (days) for processing Screener, Household Questionnaire, 
Household Folder, DHKS Questionnaire, and DHKS Folder 


Document 
ge it pons Household | Household 
Processing step Screener Questionnaire Folder DHKS* 
Coding 12 11 12 9 
Coding verification 2 a2 2 
Data entry 6 6 6 
Machine edit 5 5 5 
Transmittal to ARS 2 1 2 


1 


*Questionnaire and Folder. 


4.7 Delivery of Data to ARS 
Electronic data with matching hard-copy documents were delivered to ARS every week. 


A list of batches by document type was also included to identify the contents of the delivery. 
Electronic data were transmitted by cc:Mail. 
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Modems and - regular telephone lines were used to transmit data and other information 
during the CSFII/DHKS 1994. The cc:Mail and cc:Mail Remote packages were used for the following 
transactions: 


1. Daily delivery of FTS files; 


ee Weekly delivery of data files and reports; 


Sh Transfer of entire files of recipes and unknown foods for purposes of comparison; 
and 
4. Miscellaneous communications. 


Daily Deliveries 


A snapshot of the FTS files was produced each day and transmitted electronically to ARS. 
The system automatically compressed a copy of the FTS files into a zip file, built the text of the 
cc:Mail message listing the files being delivered, assembled the text and the files into a single package, 
and sent it to the ARS mailbox on Westat's network. The entire process took less than 5 minutes. 
When they were ready to receive the message, the staff at ARS used cc:Mail Remote to connect to 
Westat's network and download the message. The process worked well at both Westat and ARS. 


Weekly Deliveries 


Weekly deliveries of data files and reports were scheduled for the Tuesday of every week. 
The data delivery consisted of the following: 


a A cover memo; 

a Survey Net files; 

a Flat files containing non-food data from the Day 1 and Day 2 Intake 
Questionnaires; data from the Screener, Household, and DHKS Questionnaires; 


data from the Household Folder; and a file named CONTENTS, which listed the 
files being delivered with that week's message; 
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a Hard-copy data matched to the data in the flat files; and 


r] Hard-copy problem cards, code changes, decision logs, and keying error reports. 


At times, more than 200 files (including reports and Survey Net index files, recipe files, 
unknown food files, and various flat files) were transmitted during a single week. An automated 
process examined the FTS database for files marked as ready for delivery and produced (1) a list for 
use in assembling hard-copy documents to be delivered to ARS and (2) a set of computer files that 
were used by the compression routine to determine the computer (VAX or PC file server), directory, 
and name of each file in the shipment. The hard-copy list of delivery files was reviewed and approved 
by the data preparation manager before a clerk created the cc:Mail delivery message. 


The system built the draft cc:Mail message, assembled the zip files, created the contents 
list, and attached the files to the message for review. The message and files were then transmitted to 
ARS's mailbox on the Westat network. 


4.8 Data Processing Issues 


The CSFII/DHKS data preparation and processing procedures worked well, and Westat 
delivered data to ARS each week as required by the contract. However, the weekly delivery 
requirement imposed inefficiencies on the processing operations. In order to maintain a sufficient flow 
of documents to meet the delivery schedule, all of the processing tasks (i.e., coding, verifying, 
adjudicating, key entry, machine editing, delivery preparation) were performed on a small number of 
documents each week rather than grouping the documents into more efficient work units. The impact 
on one operation, machine editing and the resolution of inconsistencies, provides an example. The 
time required to machine edit documents and resolve inconsistencies is a function of both the time 
required to run the machine editing programs and the number of documents being edited. In Westat's 
experience, increasing the number of documents to be edited does not substantially increase the amount 
of editing time, and larger batches sometimes reveal patterns in the inconsistencies that are more 
difficult to identify when fewer questionnaires are being edited. The weekly delivery requirement also 
decreased the likelihood that all documents associated with a case or household would be processed 
together. Westat developed extensive special edits to check for item consistency across the documents 
associated with a case. The resolution of inconsistencies often required that delivered documents be 
pulled from ARS files for review by Westat staff. If all or most of the documents associated with a 
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case were processed together, inconsistencies could be resolved before delivery to ARS. Westat 


recommends that ARS reconsider the weekly delivery requirement for future surveys. 
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5. DOCUMENTATION OF PROBABILITIES OF SELECTION AND 
CALCULATION OF SAMPLING WEIGHTS 


In general, the analysis of survey data from complex sample designs requires the use of 
weights to compensate for variable probabilities of selection, differential nonresponse rates, and 
possible deficiencies in the sampling frame (e.g., undercoverage of certain population groups). For the 
Continuing Survey of Food Intakes by Individuals and the Diet and Health Knowledge Survey 
(CSFII/DHKS), the overall probabilities of selection were designed to vary by sex, age, and income 
level in order to meet specified precision goals for sex-age-income subgroups. For the CSFII/DHKS 
1994 (the first of 3 survey years), these probabilities ranged from approximately 1 in 60,000 for non- 
low-income females aged 30 to 39 years to approximately 1 in 11,000 for low-income males aged 50 to 
59 years and children aged 1 and 2 years. Also, the occasional use of special subsampling procedures 
to control the workload in a few area segments introduced some additional variation in the overall 


selection probabilities. 


The base weight associated with a sample person (SP) is equal to the reciprocal of the 
probability of including that person in the sample. The base weights inflate the sample to the 
population if there is no nonresponse or noncoverage in the survey. For the CSFII/DHKS, 
nonresponse can occur at different stages of data collection, for example, (1) before the enumeration of 
SPs in the household, (2) after household enumeration and the selection of SPs but before the 
completion of the Day 1 Intake interview, (3) after the Day 1 Intake interview but before the 
completion of the Day 2 Intake interview, and (4) after the Day 1 Intake interview but before the 
completion of the DHKS interview. In addition, nonresponse to the Household Questionnaire can 
occur after the selection of SPs in eligible households. Noncoverage arises when some members of the 
survey population have no chance of being selected into the sample. With the CSFII/DHKS, 
noncoverage can occur from incomplete listings of dwelling units (DUs) in selected segments or 


incomplete listings of persons within DUs. 


To compensate for nonresponse and noncoverage, the CSFIJ/DHKS 1994 data were 
weighted in the following steps. First, a base weight equal to the reciprocal of the probability of 
selection was assigned to each SP selected for the study. The base weights were then adjusted for 
nonresponse within homogeneous classes defined by variables that were determined to be correlated 


with response rates. Finally, the nonresponse-adjusted weights were calibrated to population estimates 
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from the March 1994 Current Population Survey (CPS) to compensate for random variation in the 


observed sample counts and possible undercoverage of certain groups in the area sample frame. 


As described in detail in the following sections, two sets of weights were calculated: a 
set of weights for the Day 1 Intake interviews and another set for the DHKS interviews. In addition, 
jackknife replicate weights were calculated for each of these two data sets to facilitate variance 


estimation. 


a Development of Base Weights 


The base weight associated with an SP is the reciprocal of the overall probability of 
including that person in the study. For the CSFII/DHKS 1994, SPs were selected through a complex 
multistage sample design involving the selection of primary sampling units (PSUs), area segments 
within PSUs, DUs within segments, and finally persons (SPs) within households. Consequently, the 


following components were required to calculate the overall probabilities of selection: 
k. The probability of selecting the PSU (P,); 
a The probability of selecting the segment (or chunk) within the PSU (S,,); 
oF The probability of selecting the household within the segment (H),;;); 


4. The probability that a household identified through the "missed structure 


procedure" was retained for the sample (Hy, 


af The probability of selecting an eligible person (SP) in sex-age-income domain « 
within the household for the Intake interviews (gy;,,); and 


6. The probability of selecting an eligible respondent for the DHKS. 


It should be noted that, in a few instances, a sampled segment was so large that it was 
divided into two or more subsegments of approximately equal size (called "chunks"). One 
subsegment, within which households were to be listed, was then randomly selected with probability 
proportional to estimated size. In these cases, the chunk was considered to be the segment, and the 
S,j 8 as defined above reflected the probability of selecting the given chunk within the original 
segment. In other words, if Sa was the probability of selecting the original segment and C,,; was the 


probability of selecting the chunk within the segment, the overall probability of selecting chunk i in 
segment s was S); = Si, Chsi: 


Also, note that the factor He applies to a few segments in which the number of DUs 


found through the missed structure procedure exceeded 10. In such cases, a random subsample of 10 
of the DUs was retained in the study. DUs identified through the missed structure procedure were 
subsampled solely to control the interviewing workload within the segment, and subsampling applied 
only to DUs identified through the missed structure procedure. Any additional DUs identified through 
the related but distinct "missed DU" procedure were not subsampled (i.e., all such DUs were retained 


in the sample). 


The goal of sampling was to select self-weighting samples of SPs within each sex-age- 


income domain. Thus, in segments for which the = 1, the overall probability of selecting person k in 


sex-age-income domain « in household j in segment (chunk) 7 in PSU h is expressed as follows: 


Ponce = — PrSptnaloniye (1) 


= hee 
where K_, depends only on the sex-age-income domain to which the SP was assigned at the time of 
screening.! The term H),; in formula (1) is the within-segment sampling rate used to select households 
in the segment (or chunk) and was designed to yield a self-weighting national sample of approximately 
9,500 households. The term K, in formula (1) is the reciprocal of the overall rate of selecting persons 


in domain « and can be thought of as the "desired" base weight. The values of K, used in the first 


year of the study are summarized in Table 5-1 by sex-age-income domain. 
The actual base weight for an SP in domain « was computed as follows: 


whee, = K,! Hyp (2) 


which in almost all cases is equal to the desired base weight. 


Lin a few cases, the age recorded in the Screener Questionnaire and the age reported in the Intake interview differed. For purposes of 
assigning the base weights, the age reported in the Screener was used. 
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Table 5-1. Desired SP base weights and within-household sampling rates for the CSFII/DHKS 1994 
by analytical domain 


Income group _ Probability of 
based on 130% of selecting an SP 
Analytical | Federal poverty Age group within house- Desired base 
domain guidelines (years) hold Conijk) weight (Ky) 

1 All income , 10,925.20 
2 15,983.75 
3 55,0)) 52 
4 42,584.10 
5 52,038.33 
6 55,189.90 
7 44,184.12 
8 30,004.88 
9 25,902.47 
10 22,691.13 
11 10,925.20 
12 15,983.75 
13 31,552.87 
14 41,101.56 
15 53,628.15 
16 62,985.05 
17, 48,462.68 
18 31,552.87 
19 30,897.32 
20 33,055.00 
om Low income é 10,925.20 
22 15,983.75 
23 28,838.40 
24 28,838.40 
25 23,791.50 
26 23,791.50 
27 13,989.90 
28 10,925.20 
29 13,105.06 
30 15,728.27 
ot 10,925.20 
SP 15,983.75 
33 30,004.88 
34 30,897.32 
35 36,456.04 
36 36,456.04 
37 19,928.62 
38 16,312.45 
39 23,791.50 
33,05)... 
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It should be noted that the weights given by formula (2) applied to SPs 1 year of age or 
older. For infants under 1 year of age, the weights were derived differently. This is because infants 
under 1 year of age were included in the CSFII/DHKS 1994 sample whenever another eligible SP (1 
year old or older) was selected from the household. Therefore, the probability of selecting an infant 
for the CSFII/DHKS 1994 was the same as the probability of retaining that household for the 
CSFII/DHKS. 


The probability of retaining a household for the CSFII/DHKS 1994 depended on the 
income level and composition of the household. For example, screened households containing any 
persons | to 2 years old were retained for the CSFII/DHKS with conditional certainty. Thus, for such 
households, the probability of selection is simply f = (10,925.20), where f is the overall rate at 
which households were selected for screening in 1994. On the other hand, households with persons 3 
to 5 years of age but no one between the ages of 1 and 2 years had a somewhat smaller chance of being 
retained for the CSFII/DHKS. In general, the probability of retaining households for the CSFII/DHKS 
was equal to A;f, where A; is the expected proportion of households from which SPs with specified 
characteristics would be selected. In Table 5-2, it can be seen that households with persons 3 to 5 
years of age but no one between the ages of 1 to 2 years (Set 2 in the table) would be retained for the 
CSFII/DHKS if they were assigned a sampling message between 5 and 24. Thus, A; = 0.6835 for this 
set of households. The factors required for calculating the infant weights for various subsets of the 
sample are given in Table 5-2 for completeness and reference. Within a given household, 4; is the 
maximum within-household selection probability among the individuals in the household. The 
calculation of the base weight for infants was accomplished by simply assigning the minimum base 


weight of the other SPs in the household to the sampled infant. 


Table 5-3 summarizes the weighted counts of SPs selected for the study, by sex and age. 
The corresponding March 1994 CPS estimates are also given in this table for comparison purposes. 
Note that the weighted counts in this table include both respondents and nonrespondents to the Day 1 
Intake. Also, note that the "age" used to classify SPs in this table was based on Screener information, 


which in a few cases differed from the age given in the Day 1 Intake interview. 


The base weights given in formula (2) depend only on the values of Ke and Hye 


However, for documentation purposes, all of the components entering into the calculation of the base 


weights are recorded in the weight files, including those summarized in the following sections. 


Table 5-2. Household weighting factors for deriving infant base weights 


Message 
numbers 
leading to 
selection 
Composition of household of SPs 


Non-low-income households 
Any persons 1-2 years 
Any persons 3-5 years not included in previous subset 
Any males 70+ years not included in previous subsets 
Any males 60-69 years not included in previous subsets 
Any males 50-59 years not included in previous subsets 
Any females 60-69 years not included in previous subsets 
Any females 6-11 years or any females 50-59 years not 
included in previous subsets 
Any males 6-11 years or any females 70+ years not 
included in previous subsets 
Any females 12-19 years not included in previous subsets 
Any males 12-19 years not included in previous subsets 
Any males 40-49 years not included in previous subsets 
Any females 40-49 years not included in previous subsets 
Any males 20-29 years not included in previous subsets 
Any females 20-29 years not included in previous subsets 
Any males 30-39 years not included in previous subsets 
Any females 30-39 years not included in previous subsets 


Low-income households 
Any persons 1-2 years or any males 50-59 years 
Any males 60-69 years not included in previous subset 
Any males 40-49 years not included in previous subsets 
Any males 70+ years not included in previous subsets 
Any persons 3-5 years not included in previous subsets 
Any females 50-59 years not included in previous subsets 
Any females 40-49 years not included in previous subsets 
Any males 20-39 years or any females 60-69 years not 
included in previous subsets 
Any males 6-19 years not included in previous subsets 
Any females 6-11 years not included in previous subsets 
Any females 12-19 years not included in previous subsets 
Any females 70+ years not included in previous subsets 
Any females 20-39 years not included in previous subsets 


Table 5-3. Weighted counts of SPs selected for Day 1 Intake interviews by sex and age, and 
corresponding March 1994 CPS estimates 


March Number Weighted 
1994 CPS of SPs selected count 
estimate for Day 1 of SPs 
(1,000s) Intake (1,000s)* 


Age based 
on Screener 


(years) 


Male 2,036 apap 
4,202 3,160 
6,258 5,689 

11,861 9,743 
14,776 135621 
18,941 14,205 
21,979 19,293 
17,784 14,489 
11,443 9,646 
9,019 8,027 
8,498 6,810 
Female 1,943 1,432 
4,020 3,036 
5,982 5,395 
11,297 9,561 
14,268 12,803 
19,145 16,701 
Sa IAM 19,897 
18,322 15,409 
12,236 10,613 
10,569 9,383 
12,653 


259,507 220,316 


*Weights are Day 1 base weights described in Section 5.1. 
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5.1.1 PSU Selection Probability 


With one PSU sampled per stratum, the probability of selecting PSU h in stratum s is 
equal to 


1990 
Nsh 


aE ae 
1990 

> Ni 

h =1 


(3) 


990 é 
where N,, is the 1990 population of PSU h in stratum s and L, is the number of PSUs in the frame 
in stratum s. For 24 of the 62 PSUs in the CSFII/DHKS sample, P,, = 1. 


5.1.2 Segment Selection Probability 


The probability of selecting segment i in PSU h is given by 


m0 Py Bette 
eae ~! 1990 | @ 
> Dri 
i=1 
where Die is the 1990 number of DUs in segment i in PSU h and N, is the total number of segments 


in the PSU. The 12 in the numerator of S;,,; reflects the fact that exactly 12 segments were selected 
from each PSU for the first year of the study. 


Some of the sampled segments were so large that an additional stage of sampling was 
introduced to reduce the amount of listing required. In general, these large segments were divided into 
two or more smaller chunks of approximately equal size, and one chunk was selected with probability 
proportional to estimated size. Of the 744 segments originally selected for the CSFII/DHKS 1994, 54 
were chunked according to these procedures. For these 54 segments, the overall probability of 
selecting chunk c in segment i in PSU h is 
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where D,,;, is the estimated size of the c-th chunk in the segment and m,, is the total number of chunks 


in the segment. For these cases, the chunk is essentially the segment, so that the subscript c can be 
dropped without ambiguity. All chunked segments are flagged as such in the weight files, and the 


values of Dy. are provided for them. 
521-3 Household Selection Probability 
Within each selected segment (or chunk), DUs were listed and subsampled at rates 


designed to yield a self-weighting sample of approximately 9,500 DUs. That is, listed DUs in segment 


i in PSU h were subsampled at a rate of 


- 
Hr : 6 
: AS ie 
where 
9,500 
s = 62 12 2 7) 
Dd DL Pai | (P,Sni) 
hal 721 
Dy, = the number of listed DUs in segment i in PSU h. 
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5.1.4 Probability of Retaining Missed Dwelling Units 


Westat's missed structure and missed DU procedures were designed to identify any DUs 
that may have been missed in the listing process (see Section 2.4.4). It can be shown that these 
procedures will yield a sample of DUs that have the same overall probabilities of selection as the 
Originally listed DUs (e.g., see CSFII/DHKS Project Memo #102). However, the number of missed 
DUs in a segment can occasionally be large, especially if new construction has occurred since the 
original listing was prepared. In such cases, it was desirable to subsample them to control the 
workload in the segment. In general, if the total number of DUs found by the missed structure 


procedure was more than 10, a random subsample of 10 missed DUs was retained for the study. Thus, 


1 ; 
= if Dee > 10, (9) 
hi 


gy iW if Dimissed < 10, 


where Dpissed = the number of missed DUs in the segment that were identified through the missed 


structure procedure. The subsampling procedure described above was required for only 4 of the 92 
segments for which the missed structure procedure was applied. (Any additional DUs found through 
the related but distinct missed DU procedure were not subsampled; that is, all such DUs were retained 
in the sample. Hence, no weight adjustments were required for these DUs.) 


5.1.5 SP Selection Probability 


The fourth stage of sampling involved the selection of members of a household for 
inclusion in the CSFII/DHKS. As described in Section 2.5, the screened households were randomly 
assigned to one of several nonoverlapping subsets. Within a particular subset, all members of a set of 
specified sex-age-income domains were included in the CSFII/DHKS. Application of these rules had 
the effect of designating a random subset of the total household sample for selecting members of each 


sex-age-income domain. In other words, Tgpijx, the probability of selecting the k-th SP in domain « in 
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household j in segment 7 in PSU h, was simply the proportion of DUs in the total sample from which 
an SP in domain a could have been sampled. The values of J,,;, are summarized in the next-to-last 
column of Table 5-1. 


Finally, among SPs 20 years or older in the household who completed the Day 1 Intake 
interview without the assistance of a proxy, one SP was randomly selected for the DHKS. Restricting 
the DHKS selection to SPs who completed the Day 1 Intake interview ensured the maximum linkage 
between the Intake and DHKS items. For SPs who were selected for the DHKS, the corresponding 
within-household selection probability was Igp;;./q;, where q; is the number of SPs 20 years or older in 


the household who completed the Day 1 Intake interview without the assistance of a proxy. 


5.1.6 Imputing Classification Variables Required for Weighting 


The assignment of base weights as described in the preceding sections required that sex, 
age, and income status be known for all SPs. For a small number of cases (all nonrespondents), one or 
more of the required variables were not available in the Screener Questionnaire. For these cases, 


values of the missing variables were imputed by the methods described below. 


There were six cases for which sex was missing. For each of these SPs, a value was 
imputed by generating a uniform random number between 0 and 1 and setting the sex equal to "male" 


if the random number was less than 0.5. Otherwise, the sex was set to "female." 


For the 83 cases for which age was missing, a broad age range (e.g., "under 18" or “over 
65") was often available in the abbreviated enumeration table ("neighbor information") of the Screener 
Questionnaire. This information was used to impute age by the following "hot-deck" procedure. 
First, a listing of the 6,868 SPs, sorted by message number and randomly within message number, was 
prepared. In the sorted listing, each case having a missing value for age was located. For each of 
these cases, the next listed case that was assigned the same message number and that satisfied the age 
range recorded in the abbreviated enumeration table for the case with missing age was also identified. 
The age recorded for the latter cases (referred to as “donor records") was then assigned to the 


corresponding record with the missing age. 


Finally, income level was imputed for 12 SPs. To be consistent with the procedures 
developed for selecting SPs when income information was not obtained during screening (see Section 
2.5.3), the imputation was accomplished by inspecting the information recorded by the interviewer in 
the Household Folder to determine whether or not the household included children under 6 years of 
age and no males over 18 years. If the Household Folder information indicated this to be the case, the 
household and its members were coded as low income for weighting purposes. Otherwise, the 


household was imputed as non-low income for weighting purposes. 


5.2 Development of Nonresponse Adjustments 


Unit nonresponse (i.e., whole questionnaire nonresponse) occurs when an eligible SP fails 
to respond to the survey for any reason. As described below, separate adjustments were made to 
compensate for nonresponse in the Screener interview, the Day 1 Intake interview, and the DHKS 
interview. For a given stage of adjustment, the general approach was to divide the sample into a 
number of homogeneous weighting classes, within which nonresponse-adjusted weights were calculated 
by multiplying the base weights by the corresponding inverse of the weighted response rate for the 


class. 
5.2.1 Nonresponse Adjustments for the Screener 

Initially, each of the 9,628 DUs selected for the first year of the study was assigned to 
one of the three Screener response status groups specified in Table 5-4. Note that all of the screener 


nonrespondents (S08-S13) were known to not reside in vacant or non-DUs (i.e., they were not out of 


scope) at the time of screening. 
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Table 5-4. Definition of response status groups for the Screener 


Number 


Screener of DUs 
Response Questionnaire selected 
status group dispositions in Year 1 


1. Respondents Complete* 8,333 
2. Nonrespondents Refusals or other 
nonresponset 134 


3. Out of scope Ineligible** 


* Disposition codes S01 to S03 (complete with eligibles) and S04 to S06 
(complete with no eligibles). 


+ Disposition codes S08 to $13 (unavailable for field period, language 
problem, breakoff, maximum contacts, other nonresponse). 


** Disposition code S07 (vacant, not a DU). 


Next, each DU was assigned a Screener base weight, we, defined as follows: 


ae) Cs 10,925.20 (10) 
I H™ 


U 


where fal is the probability of retaining a structure identified through the missed structure procedure. 


Note that 10,925.20 is the reciprocal of the desired probability of selecting a DU for the CSFII/DHKS 


1994, and Hie is generally 1 except for new or missed DUs in four segments in which new and missed 


DUs found through the missed structure procedure were subsampled to control the interviewers’ 


workload. 
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Nonresponse adjustment weighting classes were then defined by crossing the following 


four segment-level variables: 


if Census region (1 = Northeast, 2 = Midwest, 3 = South, and 4 = West); 
2: MSA status (1 = MSA, 2 = non-MSA); 


3. Minority status of segment (1 = "nonminority" segments, 2 = "high black" or 
"high Hispanic" segments); and 


4. Quarter of data collection. 


Within each cell defined by the above cross-classification, an adjustment factor E “" was 


computed as 


jpn seis t=] t= (1 1) 
&§ n 


where the first sum in the numerator of Es “" extended over the responding DUs in cell g (response 
status group 1) and the second sum in the numerator of ios “" extended over the nonresponding DUs in 
cell g (response status group 2). The sum in the denominator of ie “" extended over the responding 


DUs in cell g. The out-of-scope cases (response status group 3) were not used in the calculation of the 


adjustment factors. 


The reciprocal of re SS! 2 weighted response rate for the non-out-of-scope DUs in 
weighting class g. The factor ig “is a DU-level adjustment that was used to inflate the DU base 


weights to compensate for the nonresponding DUs in the Screener sample. Table 5-5 summarizes the 
values of iD “" for the 57 weighting classes. 


Table 5-5. Weighted counts of DUs and Screener nonresponse adjustment factors, by weighting class 


Weighted Screener 
Weight Weighted count of | Weighted | nonresponse 
adjust- inori count of non- count of | adjustment 
ment | Census | MSA responding | responding | out-of-scope poor 
class region | status | segment} Quarter DUs DUs DUs ees g 
1 1 1 1 1 3,190,158 480,709 1.0171 
2 1 1 1 2 3,900,296 502,559 1.0168 
3 J 1 1 5 2,949,804 480,709 1.0185 
4 1 1 1 4 2,862,402 830,315 1.0267 
5 1 1 2 1 710,138 98 ,327 1.0462 
6 1 1 2 2 458,858 65,551 1.0714 
7 1 1 2 3 1,070,670 152,953 1.0204 
8 1 1 2 4 830,315 142,028 1.0263 
9 1 2 1 1 469,784 142,028 1.0233 
10 i 2 1 2, 426,083 207,579 1.0000 
11 1 2 1 3 404,232 142,028 1.0541 
12 1 2 1 $ 677,362 32,776 1.0161 
is gy} 1 1 1 3,255,710 240,354 1.0067 
14 2 1 1 2 3,441,438 152,993 1.0095 
15 P) 1 1 5) 3,364,962 131,102 1.0097 
16 2 1 1 4 3,959;10) 240,354 1.0000 
17 2 1 2 1 688,288 185,728 1.0000 
18 2 1 2 2 557,185 163,878 1.0588 
19 2 1 2 S 710,138 87,402 1.0308 
20 2 1 2 4 568,110 163,878 1.1346 
at 2 2 1 1 LeeGyloe 327,756 1.0000 
22 2 2 1 2 1,638,780 185,728 1.0000 
23 2 2 1 3 17595,079 262,205 1.0000 
24 2 2 1 4 1,365,650 251,280 1.0080 
25 2 Z 2 4 120,177 323116 1.0000 
26 S 1 1 1 4,501,182 284,055 1.0049 
a8 | 3 1 1 2 4,107,875 513,484 1.0080 
28 ‘| 1 1 3 4,686,911 360,532 1.0093 
29 3 1 1 4 4,344,952 352,884 1.0050 
30 3 1 2 1 1,507,678 185,728 1.0072 
ai 3 1 2 Zz 15573,229 294,980 1.0069 
32 3 1 m2 3 2,029,903 395,492 1.0215 
33 3 1 eZ 4 1,584,154 229,429 1.0207 
34 3 Z 1 1 1,562,304 600,886 1.0070 
35 3 2 1 2 1,562,304 458,858 1.0070 
36 3 Bs 1 5 1,584,154 305 ,906 1.0000 
31 z] 2 1 4 1,398,426 305,906 1.0391 
38 3 2 2 1 382,382 316,831 1.0000 
eh) 3 zZ 2 Z 524,410 152,953 1.0000 


Table 5-5. Weighted counts of DUs and Screener nonresponse adjustment factors, by weighting class 
(continued) 


Weight 
adjust- 
ment 
class 


Weighted 
count of 


responding 


DUs 


responding | out-of-scope 


DUs 


Screener 
Weighted | nonresponse 
count of | adjustment 


factor, F x 


40 3 2 2 3 BRAY SES) 273,130 1.0000 
4] 3 2 2 4 426,083 185,728 1.0000 
42 4 1 1 1 3,190,158 284,055 1.0103 
43 4 1 1 Z 2,742,225 229,429 1.0239 
44 “ 1 1 3 2,611,123 185,728 1.0418 
45 4 1 1 4 3,432,698 2925195 1.0286 
46 4 1 2 1 644,587 76,476 1.0508 
47 4 1 2 Z 863,091 218,504 10177 
48 4 1 a 3 1,158,071 240,354 1.0755 
49 & 1 z 4 600,886 109,252 1.1091 
50 “ 2 1 1 548,445 96,142 1.0000 
of 4 w 1 Z 655,512 S276 1.0000 
32 o 2 ih 3 437 ,008 0 1.0000 
53 4 2 1 4 644,587 43,701 1.0000 
54 4 25 z 1 273,130 10,925 1.0000 
35 4 2 2 2 240,354 32,776 1.0455 
56 4 2 Be 3 360,532 10925 1.0303 
57 4 2 2 4 338,681 21,850 120325 


rise Pgs 9,628 | 91,573,934 | 1,463,977 | 12,805,427 
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35m Nonresponse Adjustments for the Day 1 Intake Interview 


A total of 6,868 SPs in the 8,333 households that completed the Screener were eligible 
for the Day 1 Intake interview. To compensate for the fact that not all of the 6,868 eligible SPs 
participated in the Day 1 Intake interview, the following procedures were used to adjust the SP base 
weights. 


First, each of the 6,868 SPs selected for the CSFII/DHKS 1994 was assigned to one of 
the three response status groups specified in Table 5-6. Note that for the purpose of calculating the 
nonresponse weighting adjustments described below, the four out-of-scope cases were considered to be 


"respondents."2 


Table 5-6. Definition of response status groups for the Day 1 Intake 
interview 


Number 
eligible 
SPs 


Day 1 Intake 
dispositions 


Response 
status group 


1. Respondents Complete* 5,589 
2. Nonrespondents Refusals or other 

nonresponset 1,275 
3. Out of scope Ineligible** 4 


* Disposition codes FO1 to F02 (complete with SP or proxy). 


+ Disposition codes F08 to F15 (unavailable for field period; language problem; 
breakoff; maximum contacts; moved, unable to locate; other nonresponse). 


** Disposition code F30 (out of scope). 


2 sPs who died or were institutionalized before completing the Day 1 Intake interview were ineligible. Treating such SPs as respondents in 
the weighting adjustments had the effect of assuming that a small percentage of the nonrespondents were also out of scope. 
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Next, each eligible SP was assigned an initial weight, wei , defined as follows: 
(12) 


where We is the base weight for SP i in Screener adjustment class g and is “" is the corresponding 


Screener nonresponse adjustment factor summarized in Table 5-5. 


Weighting classes for adjusting the initial Day 1 Intake weights for nonresponse were 
then identified by a CHAID analysis.3 The CHAID algorithm (which stands for "chi-square automatic 
interaction detector") provided an objective and computationally efficient way of identifying subsets of 
the sample that were internally homogeneous with respect to response rates but that maximized the 
variation in response rates between subsets. The 22 subsets (classes) that were identified by the 


CHAID analysis and that were subsequently used for weighting purposes are summarized in Table 5-7. 


Within each of the weighting classes defined in Table 5-7, a Day 1 nonresponse 
adjustment factor, Es , was computed as 


‘4 2 eer 
Whi 2 2 Whi 
feo er i=1 Bice (13) 
b Whi 


where the first sum in the numerator of ie is the sum of the initial weights of the responding SPs in 
class h and the second sum in the numerator of Ee is the sum of the initial weights of the 
nonresponding SPs in class h. The sum in the denominator of ie is the sum of the initial weights of 


the responding SPs in class h. The four "out-of-scope" cases were treated as “respondents” in the 
calculation of F! ’ ; thus, the adjustment had the effect of assuming that a very small proportion of the 


nonrespondents would have been out of scope if an Intake interview had been initiated. 


@ 
3 Magidson/SPSS Inc., 1993, SPSS” for Windows™ CHAID™, Release 6.0. 
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Table 5-7. Definition of weighting classes for adjusting the Day 1 Intake weights 


Age 
Day 1 Income based on Minority 
weighting | level based Screener Census status of 


class on Screener (years) region segment 


1 130% + ALL 
Z 130% + ALL 
3 130% + ALL 
4 130% + ALL 
5 130% + ALL 
6 130% + non-MSA ALL 
if 130% + non-MSA ALL 
8 130% + ALL 
9 130% + ALL 
10 130% + ALL 
17 130% + ALL 
12 130% + ALL 
13 130% + non-MSA ALL 
14 130% + MSA ALL 
15 130% + 70+ non-MSA ALL 
16 < 130% under 12 MSA ALL 
17 < 130% 12+ MSA ALL 
18 < 130% ALL MSA ALL 
19 < 130% under 12 non-MSA low 
20 < 130% 12-29 non-MSA low 
21 < 130% 30+ non-MSA low 
22, < 130% ALL non-MSA high 


Table 5-8 summarizes the values of F : by Day 1 Intake weighting class. The factor 
F ' is an SP-level adjustment that was applied to the initial weights, wi , of the responding SPs in 


the weighting class A to obtain the nonresponse-adjusted Day 1 Intake weight. Specifically, the 


nonresponse-adjusted Day 1 Intake weight for SP 7 in weighting class h was computed as 


Vi rn Bert 
wat pM wll (14) 
5.2.3 Nonresponse Adjustments for the DHKS 


As required by the CSFII/DHKS design, only SPs 20 years of age or over who had 
completed the Day 1 Intake interview without the assistance of a proxy were eligible for the DHKS. If 
there were two or more such respondents, one was randomly selected for the DHKS. Consequently, 


the "base weight" for the i-th person selected for the DHKS was computed as 


DHKS 


4 nn 
hi = 4, Gy Was » (15) 


where wh is the initial (Screener nonresponse-adjusted) weight for SP i in Day 1 weighting class h, q; 


is the number of SPs 20 years of age or over in the household who completed the Day 1 Intake 
interview, and Gi is the "modified" Day 1 Intake nonresponse adjustment factor for weighting class 


h. Note that Gi is referred to as the "modified" Day 1 Intake nonresponse adjustment factor (and 
thus differs from Fb) because a few SPs for whom a Day 1 Intake was completed by proxy (cases 


with a disposition code of F02) were treated as Day 1 Intake nonrespondents for weighting the DHKS. 
In other words, to derive the DHKS weights, the Day 1 nonresponse adjustment factors had to be 
recomputed using the procedures described in Section 5.2.2, but treating the cases completed by proxy 
as nonrespondents. The resulting recomputed factors are the modified factors, G . The modified 


factors used to weight the DHKS sample are given in Table 5-9. 
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Table 5-8. 


Number of 
SPs in 
sample 


Weighting 
class 


WmornNntanh WN 


NN NN RR RR RB RB RP RP Re 
NP OO MAAN AHANPWNF OC 


number of 


223,962,172 


Total 
weighted | Number of 


SPs* 


28,926,628 
17,676,622 
8,729,354 
10,205 ,694 
18,867,908 
6,236,672 
3,353,110 
40,666,952 
9,993,748 
10,632,106 
3,469,779 
3,017,286 
6,866,864 
9,828,652 
3,894,374 
3,925,040 
9,009,222 
16,952,131 
2,108,744 
2,025,603 
3,910,781 
3,664,900 


ne 


* Weights are the initial weights, W, 


+ Includes four SPs who became ineligible before Pernlenie the Day 1 Intake interview (Intake disposition 


code of F30). 


Weighted Count 
number of of non- 
responding | responding 
SPs* SPs 


179,661,189 


24,715,424 
12,614,894 
7,286,131 
7,214,120 
15,636,214 
5,763,135 
2,655,388 
31,325,056 
7,703,964 
7,233,898 
1,821,252 
2,132,862 
5,540,797 
7,343,292 
3,282,384 
5,092,200 
7,469,988 
15,271,981 
2,035,764 
2,025 ,603 
3,655,479 
3,342,704 


1275 
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Weighted 
number 
of non- 

responding 

SPs* 


4,211,204 
5,061,728 
1,443,223 
2,991,574 
3,231,694 
473,536 
697,722 
9,343,315 
2,289,785 
3,398,208 
1,648,527 
884,424 
1,326,067 
2,485,359 
611,990 
332,764 
1,539,234 
1,680,151 
72,980 

0 

255,302 
322,196 


44,300,982 


Weighted counts of SPs and Day 1 Intake nonresponse adjustment factors by weighting 
class 


Day 1 
Intake 
adjustment 


factor, F i 


1.1704 
1.4013 
L193! 
1.4147 
1.2067 
1.0822 
1.2628 
1.2983 
12972 
1.4698 
1.9052 
1.4147 
£2393 
1.3385 
1.1865 
1.0926 
1.2061 
1.1100 
1.0359 
1.0000 
1.0698 
1.0964 


Table 5-9. 


Weighted counts of SPs and modified Day 1 Intake nonresponse adjustment factors by 
weighting class 


Modified 


Weighted Day 1 
Total Weighted Number number Intake 
Number of | weighted | Number of} number of of non- of non- adjustment 
Weighting | SPsin number of responding | responding} responding factor G 1 


class sample 


SPs* 


SPs* SPs** 


SPs* 


1 28,926,628 24,715,424 4,211,204 1.1704 
2 17,676,622 12,614,894 5,061,728 1.4013 
3 8,729,354 7,286,131 1,443 ,223 1.1981 
4 10,205,694 7,160,838 3,044,856 1.4252 
5 18,867,908 15,586,593 B 201,515 1.2105 
6 6,236,672 5,711,097 529,579 1.0920 
7 3,393,110 2,655 ,388 6975722 1.2628 
8 40,666,952 31,274,788 9,392,164 1.3003 
9 9,993,748 7,616,384 23377,365 15121 
10 10,632, 106 7,087,369 3,544,736 1.5002 
11 3,469,779 1,790,355 1,679,425 1.9380 
12 3,017,286 2,132,002 884,424 1.4147 
13 6,866,864 5,483,718 1,383,146 12522 
14 9,828,652 6,763,010 3,065 ,642 1.4533 
be! 3,894,374 3,066,866 827,507 1.2698 
16 3,925,040 B,592,2 61 332,764 1.0926 
17 9,009,222 7,222,436 1,786,786 1.2474 
18 16,952,131 15,039,503 1,912,629 bolziZ 
19 2,108,744 2,035,764 72,980 1.0359 
20 2,025,603 2,025 ,603 0 1.0000 
pA! 3,910,781 3,574,639 336,142 1.0940 
Le 3,664,900 3,312,986 351,914 1.1062 


* Weights are the initial weights, 
+ Cases with Day 1 Intake dispositions of complete with SP and out of scope (disposition codes of 


FO1 and F30). 


223,962,172 


vl 
Ww, ; 


177,748,924 1,347 


46,213,247 


** Includes Day 1 Intakes completed by a proxy for an adult SP who could not complete the Intake because 
of his or her physical or mental limitations (disposition code F02) and nonrespondents (disposition codes 


F08-F15). 
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To adjust the DHKS base weights for nonresponse, each of the 2,049 SPs selected for the 
DHKS was assigned to one of the three response status groups specified in Table 5-10. The two out- 
of-scope cases (response status group 3) were considered to be "respondents" for the purpose of 
calculating the weight adjustments. 


Table 5-10. Definition of the response status groups for the DHKS 


Number of 


DHKS SPs selected 
Response Questionnaire for DHKS 
status group dispositions in Year 1 


1. Respondents Complete* 


Refusals or other 
nonresponset 


2. Nonrespondents 


3. Out of scope Ineligible** 


* Disposition codes DO1 to DO2 (complete by telephone or in person). 


+ Disposition codes D08 to D13 and D15 (unavailable for field period; 
language problem; breakoff,; maximum contacts; other nonresponse; 
moved, unable to locate). 


** Disposition code D30 (out of scope). 


Next, nonresponse weighting classes for adjusting the DHKS weights were identified by a 
CHAID analysis using selected variables* available from the Day | Intake interview. The 11 classes 
listed in Table 5-11 were identified by the CHAID analysis and used for weighting purposes. Note 
that after controlling for the variables listed in Table 5-11, sex, smoking status, and whether the SP 


was the meal planner were not significant predictors of nonresponse. 


4 These variables included sex, smoking status, and whether the SP was the meal planner, in addition to those in Table 5-11. 
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Table 5-11. Definition of weighting classes for adjusting the DHKS weights 


Poverty level 


(percent of 
DHKS Federal On 
weighting | Age group Size of poverty special Food Food 
class (years) household level) diet shopper preparer Race 


il Nonblack 
2 Black 
3 ALL 
4 <131% ALL 
5 131% + ALL 


501% + 


Within each DHKS weighting class defined in Table 5-11, the DHKS adjustment factor, 


HKS 
F, , was computed as 


sh, DHKS , <2, DHKS 
W,. + >Vw,. 
hi hi 
£ . DHKS 
We 


where the first sum in the numerator of F, HES’ extended over the responding SPs in class A and the 
: HKS : ; : 
second sum in the numerator of F, extended over the nonresponding SPs in class h. The sum in 


the denominator of F, HES extended over the responding SPs in class h. 


Table 5-12 summarizes the values of F, jaa by DHKS weighting class. The factor 


F, HKS is an SP-level adjustment that was applied to the DHKS base weights, cee 


responding SPs in the weighting class h to obtain the nonresponse-adjusted DHKS weight. 


, of the 
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Specifically, the nonresponse-adjusted DHKS weight for SP i in weighting class A was computed as 


HH. 
ADHKS = Foro op ehsy (17) 


La hi 


Table 5-12 DHKS nonresponse adjustment factors by weighting class 


DHKS 


nonresponse 
Weighted Number Number | Weighted | adjustment 
Number of number of of non- Weighted of number factor, 
Weighting | responding responding responding number of ineligible | of out-of- pons 
class SPs SPs* nonrespondents SPs scope SPs h 


1 22,866,297 239 3).995 0 1.1285 
#3 ait) ,293 2,055,707 0 1.7456 
3 2 OM anf ANE) 784,475 0 1.1488 
4 2,035,819 309,229 0 11519 
5 16,657,485 158,801 0 1.0095 
6 5,421,791 0 0 1.0000 
7 32,692,095 2,078,632 0 1.0636 
8 5,379,914 63,454 0 1.0118 
o 14,398,625 1,412,582 0 1.0981 
10 2,102,238 708,641 0 oe W(! 
11 34,276,536 2,575,386 2 1.0751 


143,860,807 13,084,862 


108,991 


*Weights are the DHKS base weights. 


5.3 Development of Calibration Adjustments 
In addition to compensating for unequal selection probabilities and nonresponse, another 


important function of weighting is to adjust for sampling variability and possible undercoverage in the 


sampling frame. Therefore, the final step of the weighting process was to "calibrate" the nonresponse- 
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adjusted weights so that the sum of the final weights equaled the corresponding March 1994 CPS 


population cell totals for the following variables>: 


i Sex; 


i Age group (seven categories based on Intake interview: 0-2, 3-5, 6-11, 12-19, 20- 
39, 40-59, 60+ years); 


wa Quarter of Intake: winter (January to March), spring (April to June), summer 
(July to September), and fall (October to December); 


ai Season of Intake (winter, spring, summer, fall); 
wi Day of week of Intake; 

a Census region (four regions); 

= MSA status (MSA vs. non-MSA); 


Ea Household income level [defined in terms of percentage of Federal poverty level in 
four categories (0-75%, 76-130%, 131-300%, 301% +)]; 


= Received Food Stamps in past 12 months; 


fi Home ownership (owned vs. not owned); 
= Presence of children under 6 years of age in household; 
& Presence of children under 6 to 17 years of age in household; 


= Number of adults in household (1, 2, 3+); 


@ Presence of female head of household 40 years old or younger and no one in the 
household under 18 years of age; 


iw Employment status ("had paid job last week") of the female head of household if 
household had a female head; otherwise, the employment status of the male head of 
household; 

= Employment status ("had paid job last week") of the SP; 

@ Race of SP (black vs. nonblack); and 


i Hispanic origin of SP (Hispanic vs. non-Hispanic). 


5 Variables provided by ARS in memorandum from J. Goldman to A. Chu, dated April 20, 1995. 
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The calibration was implemented by an iterative process known as “raking ratio 


weighting." This process: was carried out separately for each of the following four subsets specified by 
ARS: (1) males 20 years of age or older; (2) females 20 years of age or older; (3) children 0 to 5 
years of age; and (4) persons 6 to 19 years of age. As documented in Attachment 2.C, the variables 
used in the raking process differed slightly for the four ARS subsets. For example, the variable on 
SP's employment status was not applicable to the subsets of younger persons. In Attachment 2.C, the 
variables (dimensions) used in the weighting process are defined by the variable names DIM1, DIM2, 
etc., and may have different meanings for the different subsets. Most of the raking variables are 
intrinsically univariate, but a few are bivariate in structure. Also shown in Attachment 2.C are the 
March 1994 CPS population totals to which the nonresponse-adjusted (pre-raked) CSFII/DHKS 


weights were adjusted. 


The algorithm used to calculate the final (calibrated or "raked") weights for the Day 1 
Intake data (with analogous procedures for the DHKS data) was essentially as follows: 


First, for each level defined by the raking variable DJM1, an adjustment factor, Ee ; 


was computed as 


p> Noma 

DIM1 n, NR 
Wi 
v=1 


where Npyy is the March 1994 CPS control total for the given level of DJM1, wen is the 


nonresponse-adjusted Day 1 weight (or nonresponse-adjusted DHKS weight), and the denominator of 


Ee extends over the responding SPs in the given cell (level) of DJM1. An intermediate DIM1- 


adjusted weight was then calculated as 


DIM1 _ NR y(1) 
Mie = We Fon: 


3-27 


DIM1 , 


Next, the w, s calculated above were used to calculate an adjustment within each 


level of DIM2 as follows: 
pO = None. 
N71. 
1 DIM1 
LW, 


t=1 


where Np is the March 1994 CPS control total for the given level of DJM2 and where the 


denominator of F () 


DIM2 extends over the responding SPs in the given cell (level) of DIM2. An 


intermediate DIM2-adjusted weight was then calculated as 


DIM2 _ DIM1 71) 
Me = We Pom: 


The Weta 's were then used to calculate an intermediate DJM3-adjusted weight, 
ae 


raking variable, DJM13 (or DIM14, depending on the ARS subset), using the previously adjusted 


, using procedures analogous to those described above. This procedure continued up to the last 


intermediate weights. 


Using the weights developed from the previous iteration, the whole process was then 
repeated starting with DJM1 and continuing through DIJM13 (or DIM14). The iteration process 
continued until the difference between the calculated weighted sums and the corresponding CPS totals 
was acceptably small for all levels of each raking variable (i.e., within 0.005% of the corresponding 


CPS totals for each level of each raking variable). 


Table 5-13 summarizes the final weighted counts of Day 1 Intake respondents by sex and 
age group. Table 5-14 summarizes the corresponding final weighted counts of DHKS respondents by 
sex and age group. The tables also show the corresponding weighted counts using the nonresponse- 
adjusted (pre-raked) weights and the coefficients of variation of the weights. The coefficient of 
variation of the weights, cy, is defined as cy = Sy/wW, were w and Sy are the (unweighted) mean and 
standard deviation of the weights, respectively. The coefficient of variation of the weights is 
informative because 1+(cy/100)* represents the increase in the variance of survey estimates resulting 


from the variation in weights. 
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Table 5-13. 


Age group 

Sex (as (based on 

reported response in 
in Intake Intake 

interview) interview) 


less than 1 year 
1-2 years 
3-5 years 
6-11 years 
12-19 years 
20-29 years 
30-39 years 
40-49 years 
50-59 years 
60-69 years 
70+ years 


Female | less than 1 year 
1-2 years 
3-5 years 
6-11 years 
12-19 years 
20-29 years 
30-39 years 
40-49 years 
50-59 years 
60-69 years 
70+ years 


ARS 
subset 


Soe ee ree OP OP WH WH W 


NNNNNN PAW WD W 


Number of 
completed 
Day 1 
Intakes 


Weighted 
count of 
respondents 
using NR- 
adjusted 
weights 


1,239,492 
3,266,390 
5,644,612 
9,938,185 
14,157,596 
14,001,961 
19,807,733 
14,512,544 
9,403,096 
1,011,281 
6,943,331 


1,441,727 
3,136,634 
5,655,346 
97595 ,325 
12,871,005 
16,134,454 
20,908,011 
15,895,435 
1152215390 
9,846,611 
10,224,641 


223,422,199 


5-29 


Coefficient of 
variation of 
NR weights 

(%) 


Weighted 
count of 
respondents 
using final 
(raked) 
weights 


1,714,220 
4,523,747 
6,258,218 
11,860,822 
14,775,578 
18,393,401 
22,920,953 
17,154,007 
12,073,161 
8,951,750 
8,565,165 


LSE Niger he) 

4,050,853 

5,981,561 
11,296,815 
14,268,098 
18,543,867 
22,011,985 
17,169,550 
13,388,387 
11,106,847 
12,114,574 


259,507,254 


Weighted counts of Day 1 Intake respondents and coefficient of variation of weights by 
sex and age 


Coefficient 
of variation 
of final 
weights (%) 


63.96 
25.58 
39.26 
40.71 
46.55 
50.90 
59.02 
49.77 
48.29 
47.14 
38.15 


65.54 
26.34 
24.18 
37.81 
41.46 
45.37 
56.91 
44.30 
38.31 
31.20 
30.54 


Table 5-14. Weighted counts of DHKS respondents and coefficient of variation of weights by sex and 
age 


Weighted Weighted 


Age group count of DHKS count of DHKS 
Sex (as (based on Number of | respondents | Coefficient | respondents | Coefficient 
reported response completed using NR- of variation | using final | of variation 
in Intake in Intake ARS DHKS adjusted of NR (raked) of final 
interview) interview) subset | interviews weights weights (%) weights weights (%) 


20-29 years 14,518,360 19,195,165 
30-39 years 18,420,256 2157259183 


79.03 


40-49 years 13,894,199 16,959,001 76.93 
50-59 years 9,039,473 12,268, 167 T9538 
60-69 years 7,905 ,986 9,887,919 64.69 
70+ years 5,712,345 7,629,001 62.20 
Female | 20-29 years 16,098,892 17,720,158 55.44 
30-39 years 22,605,919 23,701,679 103.09 
40-49 years 15,934,033 16,510,699 64.59 
50-59 years 12,203,702 14,047,247 63.18 
60-69 years 10,298,377 11,746,325 45.92 
70+ years 10,314,125 11,475,101 51.50 


156,945 ,667 


182,865,646 


Finally, note that the age groupings given in Tables 5-13 and 5-14 do not coincide with 
those used in the raking process (see Appendix 2.C). As a result, the weighted counts shown in these 
tables may differ from the corresponding CPS totals. However, within the broad age groupings used 
in weighting, the final weighted counts agree with the corresponding CPS population totals (to within 
+0.005%). 


5.4 Generating Replicate Weights for Computation of Sampling Errors 


To facilitate the computation of sampling errors, a set of "jackknife" replicate weights 
was constructed and attached to each data record. Separate sets of replicate weights were created for 
the Day 1 Intake and DHKS data sets. Under the jackknife replication method, a prescribed number of 
subsamples (called jackknife replicates) were generated from the full sample, and the entire weighting 


process as described in the previous sections was repeated for each replicate. In this way, a series of 
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replicate weights were generated for each data record, which together with the full-sample weight can 


be used to calculate sampling errors (see Section 6.3). 


The approach used to construct the jackknife replicates was as follows. First, 19 variance 
estimation strata were formed from the 38 noncertainty PSUs by pairing adjacent PSUs in the sampling 
frame. Each PSU within a variance estimation stratum defined what is referred to as a variance 
estimation unit (VEU). Next, within each of the 24 certainty PSUs, one-half of the segments (selected 
systematically from a list that maintained the original sort order) were assigned to one VEU and the 
remaining one-half to another. Because each certainty PSU was considered to be a separate variance 
estimation stratum, a total of 43 variance estimation strata were created by this process. A jackknife 
replicate was then created by dropping out one VEU from one of the variance estimation strata and 
doubling the weight of the other VEU in that stratum. The 43 jackknife replicates were created by 
applying this process to each of the 43 variance estimation strata. By repeating the weight calculations 


for each replicate, a total of 43 final replicate weights were generated for each data record (SP). 


Table 5-15 summarizes the number of cases included in each jackknife replicate for 
selected subsets of the sample. Section 6.3 discusses the use of these jackknife replicates for variance 


estimation and provides some illustrative variance calculations. 


Table 5-15. Sample sizes by jackknife replicate and subset 


Males 20+ Females Children Persons Males 
SPs years of age | 20+ years 0-5 years 6-19 years 20+ years 
completing completing completing completing completing completing 
Day 1 Intake | Day 1 Intake | Day 1 Intake | Day 1 Intake | Day 1 Intake DHKS 


OWONAN AN PWN FH 


LA AR RW WW WW WW WW WN NN ND NW ND WN WN WNW WN PP FP PF FP RR FB 
WNrF OU WAIAMHAF WNPF DUO WAIAMH AP WNPRF OW WAIA NH PWNF OC 
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Females 
20+ years 
completing 

DHKS 


6. FACTORS INFLUENCING STATISTICAL INFERENCES 


The following sections discuss some of the factors that will affect the ability to make 
valid inferences from the data for the Continuing Survey of Food Intakes by Individuals and the Diet 
and Health Knowledge Survey (CSFII/DHKS). First, Section 6.1 defines the population of inference. 
Each year’s sample is intended to provide a cross-section of the resident population in the United 
States living in households. Section 6.2 discusses the need to use sampling weights in analysis to 
compensate for the variable rates with which sample persons (SPs) were drawn into the sample. 
Section 6.3 describes a method that can be used to calculate the sampling errors needed to properly 


interpret the survey results. 


6.1 Population of Inference 


In general, the population of inference for any given study year of the CSFII/DHKS 
consists of noninstitutionalized persons residing in the United States. Excluded from the sample are 
institutionalized individuals such as those in prisons, juvenile facilities, and nursing homes. Also 
excluded from the sample are persons living in group quarters (e.g., rooming houses), persons residing 


on military installations, and homeless persons. 


Although the above definition is conceptually straightforward, special rules were required 
in a few unusual circumstances to establish "eligibility" for weighting and analytic purposes. These 


rules included the following: 


a SPs who became institutionalized, died, or moved out of the country before the 
completion of a particular interview were considered to be ineligible for that 
interview. 


= SPs identified during screening who moved within the United States before the first 
Intake interview and who could not be successfully traced and interviewed were 
considered to be (eligible) survey nonrespondents. 


ia An attempt was made to contact by telephone SPs who moved after completing the 
Day 1 Intake interview. If the Day 2 Intake interview was not obtained, the SP 
was considered to be an eligible nonrespondent for the combined Day 1 and Day 2 
Intake interviews but a respondent for the Day 1 Intake interview. 


ra SPs selected for the DHKS who later died, became institutionalized, or moved out 
of the country before completing the DHKS were treated as ineligible for the 
DHKS. 


6.2 The Use of Weights in Analysis 


Because the CSFII/DHKS sample is based on a complex, multistage area probability 
design in which SPs were selected at rates that varied by sex, age, and income level, weights are 
generally required for the analysis of the survey results. As described in Chapter 5, these weights 
reflect the variable sampling rates used to select the CSFII/DHKS sample and include adjustments to 
compensate for differential nonresponse rates and undercoverage. Two sets of weights have been 
calculated for the CSFII/DHKS 1994, including one set of weights for the Day 1 Intake data set and 
another for the DHKS data set. Note that these two sets of weights were not designed for analyzing 
either the combined Day 1 and Day 2 Intake data set or the Household Questionnaire data set. 


The weights have the property that they sum to the March 1994 Current Population 
Survey population estimates by sex, age, Census region, income level, and other variables (see Section 
5.3). Thus, estimates of means (e.g., mean saturated fat intake) should be calculated as a weighted 


mean of the form 


where w; is the final weight for the i-th SP and yj, is the corresponding value of the survey item of 
interest. Similarly, estimates of ratios, proportions, correlations, or other population quantities should 
be computed on a weighted, rather than unweighted, basis. In most cases, use of the unweighted 


survey results may lead to misleading or invalid inferences. 


6.3 Variance Estimation 


Estimates derived from the CSFII/DHKS 1994 sample are subject to sampling error 
because only a small fraction of the target population was selected for the survey. However, 
probability sampling techniques make it possible to estimate the sampling error directly from the 
survey results. These sampling errors can be expressed either as standard errors or coefficients of 
variation (CVs, the ratio of the standard error to the estimate) or as confidence bounds around the 


estimate. 


For the CSFII/DHKS, a method of jackknife replication can be used to calculate the 
sampling errors of the survey-based estimates. Under the jackknife replication method, a specified 
number of subsamples of the full sample (i.e., replicates) are created for which the statistic of interest 
is recalculated. The variability of the replicate estimates is then used to obtain the variance of the 
Statistic. The advantage of the replication methods is that they preclude the need to specify 
complicated variance formulas.! The way in which the required jackknife replicates were created for 
the CSFII/DHKS 1994 is described in Section 5.4. In particular, it should be noted that the replicates 
were designed to reflect the stratification and clustering used in the CSFII/DHKS sample design. 


To illustrate how the sampling errors can be calculated, let y denote a weighted survey 
estimate (e.g., mean saturated fat intake per person or mean calories per meal). Further, let y:;) be the 


corresponding estimate for jackknife replicate 7. The estimated variance of y is then given by the 


formula 


K 
var(¥) = > Wy -y)’, 


JP 


where the summation extends over all K jackknife replicates. The corresponding approximate 95 


percent confidence limits around the estimate are given by 


y+1.96/var(y) . 


1 See, for example, P. McCarthy, (1966), Replication: An Approach to the Analysis of Data from Complex Surveys, Vital and Health 
Statistics, Series 2, No. 14, Washington, DC, U.S. Department of Health, Education and Welfare. 


To implement the jackknife replication method, the set of replicate weights described in 
Section 5.4 has been attached to each record in the data file. Together with the full-sample weight, the 
replicate-based sampling errors can then be computed using, for example, Westat’s variance estimation 
program, WESVAR.2_ WESVAR is a user-written SAS procedure that computes weighted survey 
estimates and their associated sampling errors. In addition to providing confidence intervals for 
sample-based estimates, WESVAR performs "modified" chi-square tests of independence in weighted 
two-way tables using estimated design effects. The modified chi-square methods used in WESVAR 
include the method proposed by Fellegi? and two methods described by Rao and Scott.4:5 


To illustrate the use of the jackknife replicate weights for calculating sampling errors and 
to provide some numerical results for checking purposes, some illustrative standard error calculations 
are summarized in Table 6-1. The standard errors shown in the table were calculated by WESVAR 
using the variance-estimation formulas presented previously. The standard errors and CVs shown in 
the table are not intended to represent the levels of precision to be expected for the Main Survey 
estimates from the CSFII/DHKS, but rather to serve as a rough check of the proper use of the replicate 


weights for variance estimation. 


Alternatively, Taylor series linearization methods can be used for variance estimation. 
For example, the commercially available software package SUDAAN can be used for this purpose.® 
For complex survey samples such as the CSFII/DHKS sample, the SUDAAN software requires that an 
appropriate "stratum" and "PSU" code be available for each record in the data file. In the 
CSFII/DHKS data file, the stratum and PSU codes to be used for this purpose are VARSTRAT and 
VARUNIT, respectively. 


2 Westat, Inc. (1993). The WESVAR SAS Procedure. Rockville, MD: Westat, Inc. 


oo Fellegi. (1980). Approximate Tests of Independence and Goodness of Fit Based on Stratified Multistage Samples. Journal of the 
American Statistical Association, 71, 665-670. 


4 J. Rao and A. Scott. (1981). The Analysis of Categorical Data from Complex Sample Surveys: Chi-Squared Tests for Goodness of Fit 
and Independence in Two Way Tables. Journal of the American Statistical Association, 76, 221-230. 


5 J. Rao and A. Scott. (1984). On Chi-Squared Tests for Multiway Contingency Tables with Cell Proportions Estimated from Survey Data. 
Annals of Statistics, 12, 46-60. 


6 B. Shah, R. Folsom, L. LaVange, S. Wheeless, K. Boyle, and R. Williams. (1993). Statistical Methods and Mathematical Algorithms 
Used in SUDAAN. Research Triangle Park, NC: Research Triangle Institute. 
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Table 6-1. 


ARS subset 


Males 20+ 
years 


Females 20+ 


years 


Children 0-5 
years 


Persons 6-19 
years 


Males 20+ 
years 


Females 20+ 


years 


Statistic 


Proportion of persons in 


Average age 


Proportion of persons in 


Proportion of persons in 
homes owned by 
household 


% of poverty)| Sample 


Under 75% 
101-130% 
301-500% 


76-100 % 
131-300% 
501+% 
Under 75 % 
101-130% 
301-500 % 


76-100 % 
131-300 % 
501+ % 


Under 75% 
101-130% 
301-500% 


76-100 % 
131-300 % 
501+ % 


Under 75% 
101-130% 
301-500 % 


76-100 % 
131-300 % 
501+ % 


Under 75% 
101-130% 
301-500% 


Under 75% 
101-130% 
301-500% 


Illustrative estimates and jackknifed standard errors for selected statistics 


Estimate 


CV of 
estimate 


18.0% 
18.2% 
3.5% 


4.7% 
1.4% 
1.6% 
15-27% 
11.4% 
Del Pe 


5.3% 
Lh % 
1.6% 


19.5% 
15.5% 
4.2% 


6.6% 
3.3% 
6.4% 


21% 
21.3% 
2.0% 


339% 
1.9% 
2.4% 


25.3% 
15.5% 
3.8% 


19.5% 
16.7% 
3.3% 
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An Employee-Owned Research Corporation 
MEMORANDUM 


940602 
Memo #22 
TO: J. Edmonds 
cc: M. Berlin, R. Slobasky, CSFII Project File 
FROM: Valerija Smith, G. Kalton, A. Chu 


SUBJECT: Sampling Strategy for Selecting Segments for the CSFII Pilot Study 
DATE: November 24, 1992 (Revised 12/9/02) 


For the CSFII pilot study, a sample of 4 area segments will be selected from 
each of 10 purposively selected PSUs. Subject to HNIS approval, the 10 PSUs are those 
given G. Kalton’s memo #13. Since the contract specifies that the pilot segments must be 
different from those to be selected for the main study, we will first select the segments for 
the main study using a Keyfitz type procedure to maximize overlap with the NALS 
segments, and then select the pilot sample from the remaining segments in the 10 PSUs.! 
The specifications given below are for selecting the segments for the main study. 
Specifications for drawing the pilot sample segments will be given later. 


For the main study, 36 segments will be selected from each sample PSU. 
The procedures to be used to select these segments in each of the 10 pilot PSUs are as 
follows: 


For a given PSU, let p; be the probability of selecting segment i in the PSU 
for NALS, and let P; be the corresponding desired probability of selecting the segment for 
the CSFII main study. Specifically, 


NALS 
Dane Wiest; 
a a Iprim 
and 
36McFst 
8 eS PeesCrsil 
2M; 
1=1 
where 
Wesy = __ the reciprocal of the probability of selecting the PSU; 


lf addition to the selected CSFII segments, any other segments in NALS (either primary or reserve) will 
ineligible for selection for the pilot study. 


M. Be the NALS measure of size for segment 1; 


aim = _ the sampling interval for selecting the primary NALS 
sample; 
CFSI : : s 
M; = sampling measure of size for segment 1 for CSFII 


= the maximum of 60 and the number of housing units in 
segment 1; 


N . CFSH , 
YM: = the total CSFII measure of size for the PSU. 


Within a PSU, divide the segments into 4 classes and define the probability 
of retaining the segment in the CSFII sample as specified below. 


CLASS Probability of retention 
A Segment in primary NALS sample, P; = p; 1 
B Segment in primary NALS sample, P: < p; P;/p; 
C Segment not in primary NALS sample, P; 2 p; (P; - p;)/(1 - p;) 
D Segment not in primary NALS sample, P; < p; 0 


Note that if a segment was selected for the primary NALS sample and P; = 
p; (class A), then this segment should be retained in the CSFII sample with conditional 
certainty. Therefore, select all segments in class A for CSFII. Let a be the number of 
segments in class A. 


Next, from class B and C combined, select an additional (36 - a) segments 
as follows: 


Let M be the sum of the probabilities of retention, summed across all 
segments in classes B and C. Sort the file of segments in the original NALS selection 
order, and select the (36 - a) segments systematically and with probabilities proportionate to 
the probability of retention, using a sampling interval of M/(36 - a). Use the WESSAMP 
sampling macro to make the selections. Produce the standard outputs for checking and 
documentation purposes. 


=e 
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MEMORANDUM 


Ji 940602 
To: Debby Vivari pie Memo # 87 
cc: A. Chu, G. Kalton, M. Berlin, CSFII Project File 


From: V. Smith 
Subject: Selection of segments for the CSFII main study 
Date: June 14, 1993 


Version: 3 


The sample of segments for the CSFII main study will be selected from 
Westat’s 62-PSU master sample. We understand that to allow sufficient time to prepare the 
segment maps, the sample of segments must be selected and verified by June 30, 1993. 
The algorithm to be used to select the sample is given in project memo #22. A copy of 
memo #22 is attached for reference. 


In the course of selecting the segments for the pilot test, we have already 
selected the segments for the main study in 4 of the 10 pilot PSUs. These are PSUs A106, 
A203, A302, and A412. To select the segments from the remaining 58 PSUs, use the 
algorithm given in attached memo #22. Note that 36 segments will be selected from each 
PSU, including all segments in “class A” as defined in memo #22. The “class A” segments 
are those to be retained within certainty. Prior to sample selection, the remaining segments 
(the class B and C segments) will be sorted in the original NALS selection order. The 
measure of size to be used in the selection of segments is a function of the retention 
probabilities required to maximize the overlap with the segments selected for NALS (see 
memo # 22). 


Assignment of n n Tr 


Once the segments are sampled, number the selected segments in each PSU 
from 1 to 36. The numbering of segments should follow the original NALS selection order 
irrespective of the class A, B, and C designations used to select the CSFII segments. Then 
use the following Table 1 to assign the segments from each PSU to one of 12 “segment 
groups.” A segment group is simply a subset of three CSFII segments. For example, in a 
given PSU, segment group 1 consists ordered segments 1, 25, 24. Segment group 2 
consists of ordered segments 3, 27 and 22, and so on up to segment group 12 which 
consists of ordered segments 23, 26, and 2. Note that the definition of the segment groups 
given in Table 1 applies to all 62 PSUs. 


Next, generate a random permutation of the integers 1, 2, 3. This should be 
done separately for each of the 62 PSUs. Let A, B, and C denote the permuted integers.! 
Similarly, generate a random permutation of the integers 1, 2, 3, and 4 (e.g., using the 
algorithm specified previously for A, B, and C), and denote the permuted integers by Q, R, 
S, and T. Assign the 12 segment groups to one of the three study years A, B, or C, and 
quarters Q, R, S, and T as indicated in Table 1. For example, suppose that for a particular 
PSU, A =2, B = 1, and C = 3. Then according to Table 1, segment groups 2, 5, 8, and 
11 should be assigned to year 1; segment groups 1, 4, 7, and 10 should be assigned to year 
2; and segment groups 3, 6, 9, and 12 should be assigned to year 3. Similarly, if Q =3,R 
= 1,S =4, and T = 2, then segment groups 1, 2, and 3 should be assigned to quarter 3, 
segment groups 4, 5, and 6 should be assigned to quarter 1, and so on. 


Check tables 


After the segments are selected, produce a frequency table showing counts 
of segments by NALS-selection status (i.e., included in NALS primary sample or not), 
separately by PSU and year/quarter. 


Table 1. Assignment of ordered segments to segment groups, years, and 
quarters 


Ordered CSFII 
segment number in PSU 


rs 
F 


group Quarter 


\o co 4) oS. SS WNre 


4 


444 NNN ADAAWA OOD 


QAD> AW NWY AWD 


10ne way of permuting the integers is the following: Assign a uniform random number, U;, to the 
integers 1, 2, and 3 to form the pairs (1, U}), (2, U2), and (3, U3). Then sort the pairs by U;. Set A equal 
to the integer corresponding to the first sorted pair. Set B equal to the integer corresponding to the second 


sorted pair. Set C equal to the integer corresponding to the third sorted pair. Note that this algorithm 
should be applied independently for each PSU. 


OF. 


WESTAT 
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MEMORANDUM 


940609 
To: M. Berlin Memo #101 
cc: J Waksberg, G. Kalton, 'V. Smith, D. Vivari, 
CSFII Project File ,/ 


From: A. Chu we 
Subject: Procedures for selecting the sample of households for CSFII 
Date: July 13, 1993 


A total of 33,352 housing units (“line numbers”) in 2,232 segments will be 
selected for the CSFII. A third of the 2,232 sample segments will be randomly allocated to 
each of the three years of the study. This translates to 744 segments per year, and about 15 
housing units per segment. Of the 2,232 segments to be selected for CSFII, we have 
estimated that about 1,300 will be previously-listed NALS segments. Outlined below are 
the procedures to be used to select the sample of housing units for CSFII. 


Calculation of Overall Sampling Rate. f 
For the first year of data collection, the overall sampling rate for selecting 


1, 


housing units is given by f = : N a where N is the estimated number of housing units in 
the nation. N will be calculated as: 


L 
62) yyy 12 (| 

N = at eeu) 
2 (F; p> Pith 


where P,, is the probability of selecting PSU h, Nii is the number of listed housing units in 
segment j in PSU h, and P3q, is the conditional probability of selecting segment jinPSUh 
for the first year of the study. For the NALS segments, the Nis refer to the numbers of 


housing units originally listed for NALS (i.e., not including new or missed structures 
added through the “missed structures” procedure). 


lection of Households in non-NA n 


At the completion of the listing operation, let Nii be the number of housing 


units that are listed in segment j in PSU h. The Ny; housing units in the segment will be 
subsampled with equal probabilities at a rate of 


ae 


The overall sampling rate is P,P fh; = f. 


lection of Households in NA n 


Let Nii be the number of housing units that were originally listed for NALS 


in segment j in PSU h. For the NALS segments, the count Ni. should not include any 


structures or dwelling units that were added as a result of the “missed structure” or “missed 
DU” procedures. 


Of the Nii housing units in the segment that were originally listed, the 


tee housing units that were selected for NALS will be identified and excluded from the 


sampling process. The remaining Nii - tt housing units will then be subsampled at a 


Tate of 


™ = Né 
hj NE. _ NALS 
hy een 
P,P ith L 
hj 
NE. . ANALS 
where aes is the probability that a housing unit in the segment was not selected 
hj 

__ pNALs 

for NALS. The overall sampling rate is P,Pi, Piet fy = f 
hj 


Application of Missed-Structure Procedure for CSFII 


A segment selected for CSFII will be updated through the missed-structure 
procedure if the first housing unit in the segment is included in the sample for CSFII. This 
Tule applies to both the NALS and non-NALS segments. Since housing units previously 
selected for NALS will be excluded from the CSFII sample, a NALS segment that was 
designated for the missed-structure procedure in NALS will not be designated for the 
missed-structure procedure in CSFII. In effect, the updating work that was done 
previously for NALS will not be used to select the housing units for CSFII. No bias is 
introduced since new or missed housing units will still have their appropriate chances of 
selection through the missed structure procedure. 


9s 


Treatment of Chunked Segments 


In some cases, a NALS segment was so large that it was divided into a 
number of subareas (chunks) of approximately equal size. One subarea was then selected 
for listing. We anticipate that for some large non-NALS segments, similar chunking 
procedures will be needed. The sampling procedures described above will apply to these 
chunks with one exception. For the chunked segments, the Pip, defined above will be 
adjusted to reflect the conditional probability of selecting the subarea within the PSU. 


eects rie Housing Unili for CSFII 


The following information will be needed to select the samples of housing 
units for CSFII. 


(a) For each CSFII segment (both NALS and non-NALS), we will need (i) the 
probability of selecting the PSU in which the segment is located, (ii) the probability of 
selecting the segment within the PSU (i.e., CSFII selection probability corresponding to 36 
segments per PSU), (ili) whether or not the segment was chunked, (iv) the conditional 
probability of selecting the chunk within the segment, if the segment was chunked, (v) the 
year and quarter to which the segment is assigned. 


For each non-NALS segment, we will need (i) the number of housing units 
reported in the Census file, and (ii) the actual number of listed housing units. 


(c) For each NALS segment, we will need (1) the number of housing units 
reported in the Census file, and (ii) the final count of housing units originally listed for 
NALS (not including added structures or DUs). 


(d) For each NALS segment we will need (1) the count of housing units selected 
for NALS, and (ii) the list of line numbers selected for NALS. 
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MEMORANDUM 
/ 940609 
TO: CSFII Project File * Memo #102 
ce: G. Kalton, V. Smith, M. Berlin 
FROM: A. Chu 


SUBJECT: Note on probability of selecting first DU in segment 
DATE: July 20, 1993 


As part of Westat’s listing QC procedures, we will apply the “missed 
structure” procedure to a sample segment if the first DU in the segment is selected for 
CSFII. For CSFII, we will exclude from sampling any DU previously selected for NALS. 


Then, in a given NALS segment, 
Pr({first DU in segment is selected for CSFII} 


= Pr{first DU in segment is not selected for NALS} 
x Pr{first DU is selected from the remaining non-NALS DUs} 


(1 7 ae ( NcFsil ) 
N JN - ONars 
Nc 


SFI 
N 


where N is the number of DUs in the segment that were listed for NALS, nyays is number 
of DUs selected for NALS, and nesfy is the number DUs to be selected for CSFII. Note 
that N is the number of originally-listed NALS DUs, and does not include any additional 
DUs found as a result of the missed structures procedures, if applied. 


Since “csr is the “desired” probability of selecting the first DU for CSFII, 


segments will be designated for the missed structure procedure at the appropriate rates. 
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An Employee-Owned Research Corporation 


MEMORANDUM 


940607 
Memo #109 
TO: Martha Berlin fe 
cc: G. Kalton, V. Smith, J. Waksberg, CSFII project file 


FROM: A. Chu 


SUBJECT: Modification of procedures for assigning households to income classes for 
sampling 


DATE: August 18, 1993 


In our Pilot Study draft evaluation report, we tentatively recommended 
using the Pilot Study procedures for assigning households to income classes in sampling 
for at least the first year of the Main Survey (i.e., Sampling Recommendation 3). 
However, we also stated that we would continue to reexamine these rules and make any 
additional changes if warranted. Upon further review of the Pilot Study results, it now 
appears desirable to modify the earlier rules for the Main Survey. 


The rules established for the Pilot Study required the identification of “low- 
income” segments and “nonlow-income” segments. The rules for classifying a household 
into income classes was based on the characteristics of the members of the household, and 
depended on whether the segment was classified as low income or nonlow-income. The 
rules used in the Pilot Study are summarized below. 


Rules Used in the Pilot Study 


Rule 1 (applied to low-income segments 


If the household was in a low-income segment and income was not 
obtained in screening, the interviewer was instructed to determine whether 
there was a male age 18 or over in the household and one or more children 
under 18 years. If there was no male age 18 or over, but one or more 
children under 18, the household was treated as low income for sampling 
purposes. Otherwise, the household was treated as non-low-income. 


Rule 2 (appli non-low-income se nts 


If the household was in a non-low-income segment and income was 
not obtained in screening, the interviewer was instructed to determine 
whether there was a male age 18 or over in the household and one or more 
children under 6 years. If there was no male age 18 or over, but one or 
more children under 6, the household was treated as low income for 
sampling purposes. Otherwise, the household was treated as non-low- 
income. 


As it turned out, the need to apply the above rules in the Pilot Study was 
infrequent. Of the 552 occupied households in the screener sample, the screener question 
on income was required for 139 cases (or 25 percent of the occupied households), and of 
these, 128 answered the question on income. This left only 11 cases for which the above 
rules were required. 


Based on the Pilot Study experience, we expect that relatively small 
numbers of cases will require such rules in the Main Survey. Consequently, it seems 
desirable to simplify procedures by employing a single rule that would be applicable in all 
cases. In particular, we propose that the following rule be used in the Main Survey. 


Proposed Rule for Main Survey 
If income is not obtained in screening, the interviewer will be 
instructed to determine whether there is a male age 18 or over in the 
household and one or more children under 6 years. If there is no male age 
18 or over, but one or more children under 6, the household will be treated 
as low income for sampling purposes. Otherwise, the household will be 
treated as non-low-income. 


Note that the proposed rule is simply Rule 2 as specified for the Pilot Study. 
Consequently, it is the rule that would have been applied in the majority of cases anyway 
(.e., in the nonlow-income segments) if the Pilot Study rules were employed. Even in 
re segments, this rule will have a good chance of identifying low-income 
ouseholds. 
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MEMORANDUM 


940621 
Memo #139 


TO: Martha Berlin ; 
cc: G. Kalton, R. Slobasky, V. Smith, CSFII Project File 


FROM: A. Chu 
SUBJECT: Projections of sample sizes to be expected in the CSFII Main Survey 
DATE: October 29, 1993 


The sample design for the CSFII is a multistage, stratified area probability 
sample. At the first stage of selection, a stratified sample of 62 primary sampling units 
composed of MSAs, individual counties, or groups of counties was selected with 
probabilities proportionate to 1990 population within strata defined by MSA status and 
Census region. At the second stage of selection, 36 area segments defined to be Census 
blocks or block groups were selected with probabilities proportionate to the number of 
housing units in the segment from each PSU. The 36 segments in each PSU were divided 
into three subsets of 12 segments each, and one subset was randomly assigned to each of 
the three years of CSFII. Thus, 744 area segments (out of the 2,232 area segments 
selected for the entire three-year study) were allocated to each year. Within each area 
segment, a comprehensive listing of housing units will be compiled and a random sample 
of households will be selected at rates designed to yield an overall self-weighting sample of 
households. 


Following the procedures described in the Survey Operations Plan (SOP), 
the sampled households will then be randomly assigned one of a prescribed number of 
“sampling messages,” where each sampling message specifies the individuals in the 
household to be included in the survey. In the CSFII Pilot Study, a set of 16 sampling 
messages was used to designate persons for inclusion in the survey (e.g., see Table 1-3 in 
Pilot Study Evaluation Report, October 1993). While these messages seemed to work well 
in the Pilot Study, the sample was too small to provide reliable projections of the sample 
sizes to be expected in the Main Survey for the 40 sex-age-income groups. Moreover, the 
original sampling rates used to construct the 16 sampling messages did not take account of 
the potential undercounting of certain individuals in area sampling designs. For example, 
analysis of the 1992 National Health Interview Survey (NHIS) national samples indicates 
that the NHIS coverage rate for the entire U. S. population was about 90 percent. It 
seemed desirable, therefore, to adjust the CSFII sampling rates to compensate for 
undercoverage, and then use these adjusted rates to revise the sampling messages. 


Table 1 gives the revised sampling messages for the first year of CSFII 
based on this analysis. While we have reduced the maximum of 40 messages to 24, this is 
somewhat larger than the 16 messages used in the Pilot Study. However, we expect the 24 
messages to provide a somewhat better ability to achieve the specified sample size targets 
by sex-age-income group. Also shown in Table 1 are the proportions of households to be 


assigned to the various messages. Table 2 shows the corresponding projections of the 
sample sizes to be expected for all three years of the Main Survey by sex-age-income 
domain. Except for a few sex-age domains where the overall rates will yield more low- 
income persons than desired, the projections are the target sample sizes specified in the 
Survey Operations Plan. 


The sample sizes for the Main Survey will depend on the percentage of 
households containing a sample person (SP), the average number of sample persons per 
eligible household, and the coverage rate of individuals in area samples. The percentage of 
households with SPs and the average number of SPs per eligible household are 
summarized in columns (4) and (7) of Table 3 by sampling message. They are national 
figures derived from the 1991 CPS public use data files. Column (7a) of Table 3 shows 
the corresponding expected numbers of SPs in eligible households assuming a coverage 
rate of 90 percent. If these national averages hold for CSFII sample, we would expect a 
sample of about 9,500 households in the first year of the Main Survey to yield about 3,000 
completed household questionnaires and about 5,200 completed day 1 intake interviews. 
These projections assume a response rates of 85 percent for the household interviews and a 
response rate of 80 percent for the day 1 intake interviews. The 80 percent response rate 
assumed for day 1 intake interviews is somewhat lower than that achieved in the Pilot 
Study, but exceeds the requirements specified in the SOP. 


In addition, our projections indicate that the initial sample of 9,500 
households for the first year of CSFII will yield almost 2,000 completed DHKS interviews 
(assuming a 90 percent response rate for the DHKS). 


Finally, we note that the assumptions used in the sample size projections 
(e.g., coverage and response rates) tend to be on the conservative side. If either the 
coverage rate or response rates in CSFII are higher than those assumed in this memo, the 
resulting sample sizes will exceed the specified targets. Also, the achieved sample sizes 
will be subject to considerable sampling variability; thus, further adjustment of sampling 
rates may be necessary for the second and third years of the study. 


—28 


Table 1. Sampling messages for the CSFII Main Survey 


Characteristics of persons to be included in sample 


Proportion of 

households to 
Message | All-income | Low-income | All-income Low-income | be assigned 
number males males females females message 


a ee es 
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0.1215 
0.0667 
0.0223 
0.0374 
0.0429 
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14 1 to 5, 50+ 6 to 49 69 to 49 0.0216 
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16 0.0339 
17 0.0093 
18 0.0093 
19 0.0218 
20 0.0155 
21 0.0062 
22 0.0058 
23S | ot | | 5 110020404 | 830-10 39] 0.0245 
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Table 2. Expected sample sizes for all three years of CSFII 


Non-low- 
income 


Low-income 


Subtotal 

Female 719 
J23 
721 
719 
739 
794 
850 
858 
795 
720 


Subtotal 7,638 


15,505 


Ete 11,262 4,243 
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2.C Variables Used in Calibration Adjustments 


and CPS Control Totals, by ARS Subset 
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Attachment 2.C 
Variables Used in Calibration Adjustments and 
CPS Control Totals, by ARS Subset 


ARS Subset 1 (males 20+ years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables 


CSFII 
sample size Pre-raked Final (post- 
PS_MSA (Day 1 CSF CSFII raked) CSFIT_ March 1994 CPS Ratio CPS 
DIM1 (new) (METRO) resp.) estimate percent estimate CPS percent to CSFII 
1 1 (MSA) 1,195 56,109,981 77.3% 69,090,994 69,090,997 78.8% 1.23 
2 2 (mon-MSA) 454 16,435,964 22.7% 18,573,444 18,573,440 21.2% 1.13 
Total 1,649 72,545,945 100.0% 87,664,437 87,664,437 100.0% AA 
CSFII 
sample size Pre-raked Final (post- 

DIM12 (Day 1 CSF CSFII raked) CSFIT March 1994 CPS Ratio CPS 
(new) REGION resp.) estimate percent estimate CPS percent to CSFII 
1 1 Northeast 305 13,723,850 18.9% 17,566,643 17,566,644 20.0% 1.28 
2 2 Midwest 390 16,516,345 22.8% 20,409,460 20,409,459 23.3% 1.24 
3 3 South $79 26,339,398 36.3% 30,230,682 30,230,680 34.5% 11 JIGS 
4 4 West 375 15,966,352 22.0% 19,457,652 19,457,654 22.2% 1.22 

Total 1,649 72,545,945 100.0% 87,664,437 87,664,437 100.0% 1221 
CSFII 
sample size Pre-raked Final (post- 
(Day 1 CSF CSFIL raked) CSFIT_ March 1994 CPS Ratio CPS 
DIM2 KIDS KID17 resp.) estimate percent estimate CPS percent to CSF 
1 0 (no) 0 (no) 1,058 42,818,000 59.0% 53,526,325 53,526,302 61.1% 1225 
2 0 (no) 1 (yes) 323 15,852,860 21.9% 17,597,803 17,597,810 20.1% tet 
3 1 (yes) 0 (no) 128 6,756,655 9.3% 8,680,536 8,680,549 9.9% 1.28 
4 1 (yes) 1 (yes) 140 7,118,431 9.8% 7,859,773 7,859,777 9.0% 1.10 
Total 1,649 72,545,945 100.0% 87,664,437 87,664,437 100.0% feo 
CSFII 
sample size Pre-raked Final (post- 
(Day 1 CSFII CSFII raked) CSFIT March 1994 CPS Ratio CPS 
DIM3 ADULT1 ADULT2 resp.) estimate percent estimate CPS percent to CSFII 
1 0 (no) 0 (no) 412 18,245,932 25.2% 25,283,428 25,283,442 28.8% 1.39 
0 (no) 1 (yes) 1,034 46,041,065 63.5% 52,305,908 52,305,892 59.7% 1.14 
3 1 (yes) 0 (no) 203 8,258,948 11.4% 10,075,101 10,075,103 11.5% i rlp2 
Total 1,649 72,545,945 100.0% 87,664,437 87,664,437 100.0% Le2) 


ARS Subset 1 (males 20+ years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM4 


Total 


DIM6 


bh Wh 


Total 


Total 


DIM8 


nn bh WW 


Total 


FH40 
0 (no) 


1 (yes) 


HAVEJOB 


0 (no) 
1 (yes) 


POVGRP 


1 (0-75 %) 

2 (16-130%) 
3 (131-300%) 
4 (301% +) 


STAMP12 


0 (no) 
1 (yes) 


OWNHOME AGEGRP 


0 (no) 
0 (no) 
0 (no) 
1 (yes) 
1 (yes) 
1 (yes) 


5&6 (20-39) 
7 (40-59) 
8&9 (60+) 
5&6 (20-39) 
7 (40-59) 
8&9 (60+) 


CSFII 
sample size 
(Day 1 
resp.) 

1,545 


104 


1,649 


CSFII 
sample size 
(Day 1 


resp.) 


580 
1,069 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


156 
228 
540 
725 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


1,510 
139 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


274 
136 

71 
305 
434 
429 


1,649 


Pre-raked 
CSFII 
estimate 


66,539,981 


6,005,964 


72,545,945 


Pre-raked 
CSFII 
estimate 


18,319,351 
54,226,594 


72,545,945 


Pre-raked 
CSFII 
estimate 


3,808,283 
5,617,979 
25,027,137 
38,092,547 


72,545,945 


Pre-raked 
CSFII 
estimate 


68,726,357 
3,819,588 


72,545,945 


Pre-raked 
CSFII 
estimate 


13,767,341 
4,489,494 
1,849,771 

20,042,354 

19,426,146 

12,970,841 


72,545,945 


CSFII 
percent 
91.7% 


8.3% 


100.0% 


CSFII 
percent 


25.3% 
74.7% 


100.0% 


CSFII 
percent 


5.2% 
7.7% 
34.5% 
52.5% 


100.0% 


CSFII 
percent 


94.7% 
5.3% 


100.0% 


CSFII 
percent 


19.0% 
6.2% 
2.5% 

27.6% 

26.8% 

17.9% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


81,267,772 


6,396,666 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


26,478,584 
61,185,853 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


4,572,819 
7,120,843 
28,000,522 
47,970,253 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


82,025,630 
5,638,807 


87,664,437 


Final (post- 
raked) CSFIL 
estimate 


17,768,206 
6,556,230 
2,669,630 

23,152,149 

22,670,938 

14,847,285 


87,664,437 


March 1994 
CPS 
81,267,770 


6,396,667 


87,664,437 


March 1994 
CPS 


26,478,525 
61,185,912 


87,664,437 


March 1994 
CPS 


4,572,820 
7,120,844 
28,000,514 
47,970,259 


87,664,437 


March 1994 
CPS 


82,025,625 
5,638,812 


87,664,437 


March 1994 
CPS 


17,768,207 
6,556,231 
2,669,630 

23,152,149 

22,670,937 

14,847,284 


87,664,437 


CPS 
percent 
92.7% 


7.3% 


100.0% 


CPS 
percent 


30.2% 
69.8% 


100.0% 


CPS 
percent 


5.2% 
8.1% 
31.9% 
54.7% 


100.0% 


CPS 
percent 


93.6% 
6.4% 


100.0% 


CPS 
percent 


20.3 % 
7.5% 
3.0% 

26.4% 

25.9% 
16.9% 


100.0% 


Ratio CPS 
to CSFII 


1822 


1.07 


1.21 


Ratio CPS 
to CSFII 


1.45 
Les 


1.21 


Ratio CPS 
to CSFII 


1.20 
LP 
1.12 
1.26 


1.21 


Ratio CPS 
to CSFII 


1.19 
1.48 


V2) 


Ratio CPS 
to CSFII 


129 
1.46 
1.44 
1.16 
Ila 
1.14 


221 


ARS Subset 1 (males 20+ years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM9 (new) BLACK 

1 0 (no) 
2 1 (yes) 

Total 

DIM13 

(new) HISPANIC 
i 0 (no) 
2 1 (yes) 

Total 

DIM10 SEASON 
1 1 (Winter) 
2 2 (Spring) 
3 3 (Summer) 
4 4 all) 

Total 

DIM11 DAY_ITK 
1 1 (Sunday) 
2 2 (Monday) 
3 3 (Tuesday) 
4 4 (Wednesday) 
5 5 (Thursday) 
6 6 (Friday) 
7 7 (Saturday) 

Total 


CSFII 
sample size 
(Day 1 
resp.) 


1,477 
172 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


1,497 
isp 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


373 
420 
438 
418 


1,649 


CSFII 
sample size 
(Day 1 
resp.) 


284 
269 
234 
194 
165 
292 
211 


1,649 


Pre-raked 
CSFII 
estimate 


64,814,735 
UTR 6 


72,545,945 


Pre-raked 
CSFII 
estimate 


66,519,105 
6,026,841 


72,545,945 


Pre-raked 
CSFII 
estimate 


15,385,865 
18,650,168 
20,329,408 
18,180,504 


72,545,945 


Pre-raked 
CSFII 
estimate 


12,403,435 
11,120,898 
10,345,722 
8,555,994 
7,611,348 
12,878,433 
9,630,115 


72,545,945 


CSFII 
percent 


89.3% 
10.7% 


100.0% 


CSFII 
percent 


91.7% 
8.3% 


100.0% 


CSFII 
percent 


21.2% 
25.7% 
28.0% 
25.1% 


100.0% 


CSFII 
percent 


17.1% 
15.3% 
14.3% 
11.8% 
10.5% 
17.8% 
13.3% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


78,419,902 
9,244,535 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


79,524,332 
8,140,105 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


21,916,109 
21,916,109 
21,916,110 
21,916,109 


87,664,437 


Final (post- 
raked) CSFII 
estimate 


12,523,492 
12,523,491 
12,523,491 
12,523,490 
12,523,491 
12,523,492 
12,523,491 


87,664,437 


March 1994 
CPS 


78,419,903 
9,244,534 


87,664,437 


March 1994 
CPS 


79 524,332 
8,140,105 


87,664,437 


March 1994 
CPS 


21,916,109 
21,916,109 
21,916,109 
21,916,109 


87,664,437 


March 1994 
CPS 


12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 


87,664,437 


CPS 
percent 


89.5% 
10.5% 


100.0% 


CPS 


percent 


90.7% 
9.3% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to CSFII 


pail 
1.20 


1.21 


Ratio CPS 
to CSFII 


Ratio CPS 
to CSFII 


1.42 
1.18 
1.08 
Agi 


2 


Ratio CPS 
to CSFII 


1.01 
113 
1.21 
1.46 
1.65 
0.97 
1.30 


1.21 


ARS Subset 2 (females 20+ years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables 


DIM1 (new) 


Total 


DIM2 


hwWN ee 


Total 


DIM3 


WON 


Total 


PS_MSA 


(METRO) 


1 (MSA) 


2 (non-MSA) 


REGION 


1 Northeast 


2 Midwest 
3 South 
4 West 


KIDS 


0 (no) 
0 (no) 
1 (yes) 
1 (yes) 


ADULT1 


0 (no) 
0 (no) 
1 (yes) 


KID17 


ADULT2 


0 (no) 
1 (yes) 
0 (no) 


CSFII 
sample size 
(Day 1 
resp.) 


1,215 
427 


1,642 


CSF 
sample size 
(Day 1 


resp.) 


306 
422 
581 
333 


1,642 


CSFII 
sample size 
(ay 1 


resp.) 


1,007 
338 
141 
156 


sample size 
(Day 1 
resp.) 


351 
923 
368 


1,642 


Pre-raked 
CSFII 
estimate 


64,861,774 
19,368,768 


84,230,542 


Pre-raked 
CSFII 
estimate 


15,688,410 
20,864,209 
30,868,968 
16,808,955 


84,230,542 


Pre-raked 
CSFIL 
estimate 


47,709,784 
19,212,093 
8,153,771 
9,154,894 


84,230,542 


Pre-raked 
CSFII 
estimate 


18,757,262 
49,544,265 
15,929,015 


84,230,542 


CSFII 
percent 


77.0% 
23.0% 


100.0% 


CSFII 
percent 


18.6% 
24.8% 
36.6% 
20.0% 


100.0% 


CSFII 
percent 


56.6% 
22.8% 

9.7% 
10.9% 


100.0% 


CSF 
percent 


22.3% 
58.8% 
18.9% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


74,919,992 
20,281,217 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


19,685,798 
22,383,173 
33,189,840 
19,942,399 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


54,505,481 
20,650,117 
10,444,905 

9,600,706 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


22,062,703 
53,357,430 
19,781,077 


95,201,209 


March 1994 
CPS 


74,920,030 
20,281,179 


95,201,209 


March 1994 
CPS 


19,685,799 
22,383,178 
33,189,842 
19,942,391 


95,201,209 


March 1994 
CPs 


54,506,862 
20,649 ,674 
10,444,403 

9,600,271 


95,201,209 


March 1994 
CPS 


22,062,595 
53,357,195 
19,781,419 


95,201,209 


CPS 
percent 


78.7% 
21.3% 


100.0% 


CPS 
percent 


20.7% 
23.5% 
34.9% 
20.9% 


100.0% 


CPS 
percent 


57.3% 
21.7% 
11.0% 
10.1% 


100.0% 


CPS 
percent 


23.2% 
56.0% 
20.8% 


100.0% 


Ratio CPS 
to CSFII 


1.16 
1.05 


1.13 


Ratio CPS 
to CSFII 


125 
1.07 
1.08 
1.19 


1°13 


Ratio CPS 
to CSFII 


1.14 
1.07 
1.28 
1.05 


Lang) 


Ratio CPS 
to CSFII 


1.18 
1.08 
1.24 


1-13 


ARS Subset 2 (females 20+ years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM4 


Ne 


Total 


DIMS5 


Total 


DIM6 


WW 


Total 


DIM7 


Total 


DIM8 


AUnNkwWN 


Total 


FH40 


0 (no) 
1 (yes) 


HAVEJOB 


0 (no) 
1 (yes) 


POVGRP 


1 (0-75%) 

2 (76-130%) 
3 (131-300%) 
4 (301% +) 


STAMP 12 


0 (no) 
1 (yes) 


OWNHOME 


0 (no) 
0 (no) 
0 (no) 
1 (yes) 
1 (yes) 
1 (yes) 


AGEGRP 


5&6 (20-39) 
7 (40-59) 
8&9 (60+) 
5&6 (20-39) 
7 (40-59) 
8&9 (60+) 


CSFII 
sample size 
(Day 1 
resp.) 


1,476 
166 


1,642 


CSFII 
sample size 
(Day 1 


resp.) 


804 
838 


1,642 


CSFII 
sample size 
(Day 1 
resp.) 


197 
217 
549 
679 


1,642 


CSFII 
sample size 
(Day 1 
resp.) 


1,457 
185 


1,642 


CSFII 
sample size 
(Day 1 


resp.) 


291 
143 

93 
275 
448 
392 


1,642 


Pre-raked 
CSFII 
estimate 


73,234,832 
10,995,710 


84,230,542 


Pre-raked 
CSFII 
estimate 


35,650,678 
48,579,864 


84,230,542 


Pre-raked 
CSFIl 
estimate 


6,843,966 
USTUPAY) 
29,958,177 
39,851,100 


84,230,542 


Pre-raked 
CSFII 


estimate 


77,242,381 
6,988,161 


84,230,542 


Pre-raked 
CSFII 
estimate 


16,784,760 
4,916,714 
3,723,079 

20,257,704 

22,200,111 

16,348,173 


84,230,542 


CSFII 


percent 


86.9% 
13.1% 


100.0% 


CSFII 
percent 


42.3% 
57.7% 


100.0% 


CSFII 


percent 


8.1% 
9.0% 
35.6% 
47.3% 


100.0% 


CSFII 
percent 


91.7% 
8.3% 


100.0% 


CSFII 
percent 


19.9% 
5.8% 
4.4% 

24.1% 

26.4% 

19.4% 


100.0% 


Final (post- 
raked) CSFII 


estimate 


84,991,730 
10,209,479 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


42,384,241 
52,816,968 


95,201,209 


Final (post- 
raked) CSFII 


estimate 


8,479,615 
10,476,973 
30,969,945 
45,274,676 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


85,346,849 
9,854,360 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


18,627,645 
6,845,433 
4,887,770 

22,794,207 

23,712,503 

18,333,652 


95,201,209 


March 1994 
CPS 


84,992,079 
10,209,130 


95,201,209 


March 1994 
CPS 


42,385,196 
52,816,013 


95,201,209 


March 1994 
CPS 


8,479 ,573 
10,477,066 
30,970,034 
45,274,536 


95,201,209 


March 1994 
CPS 


85,347,070 
9,854,140 


95,201,209 


March 1994 
CPS 


18,627,631 
6,845,428 
4,887,770 

22,794,198 

PMI Pap pH) 

18,333,661 


95,201,209 


CPS 


percent 


89.3% 
10.7% 


100.0% 


CPS 
percent 


44.5% 
55.5% 


100.0% 


CPS 
percent 


8.9% 
11.0% 
32.5% 
47.6% 


100.0% 


CPS 
percent 


89.6% 
10.4% 


100.0% 


CPS 
percent 


19.6% 
7.2% 
5.1% 

23.9% 

24.9% 

19.3% 


100.0% 


Ratio CPS 
to CSFII 


1.16 
0.93 


1.13 


Ratio CPS 
to CSFII 


ey te 
1.09 


1.13 


Ratio CPS 
to CSFII 


1.24 
1.38 
1.03 
1.14 


1.13 


Ratio CPS 
to CSFII 


1.10 
1.41 


JL} 


Ratio CPS 
to CSFII 


Te 
1639 
1.31 
113 
1.07 
12i2 


1.13 


ARS Subset 2 (females 20+ years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM9 (new) BLACK 
1 0 (no) 
2 1 (yes) 
Total 
DIM13 
(new) HISPANIC 
1 0 (no) 
2 1 (yes) 
Total 
DIM10 SEASON 
1 1 (Winter) 
a 2 (Spring) 
<j 3 (Summer) 
4 4 (Fall) 
Total 
DIM11 DAY_ITK 
1 1 (Sunday) 
ez 2 (Monday) 
3 3 (Tuesday) 
4 4 (Wednesday) 
S) 5 (Thursday) 
6 6 (Friday) 
7 7 (Saturday) 
Total 


CSFII 
sample size 
(Day 1 
resp.) 


1,428 
214 


1,642 


CSFII 
sample size 
(ay 1 
resp.) 


1,492 
150 


1,642 


CSFII 
sample size 
(ay 1 
resp.) 


395 
399 
433 
415 


1,642 


CSFII 
sample size 
(Day 1 


resp.) 


301 
266 
238 
193 
163 
280 
201 


1,642 


Pre-raked 
CSFII 


estimate 


72,588,626 
11,641,916 


84,230,542 


Pre-raked 
CSFII 


estimate 


77,093,943 
7,136,599 


84,230,542 


Pre-raked 
CSF 
estimate 


19,467,912 
20,431,068 
23,209,939 
21,121,623 


84,230,542 


Pre-raked 
CSFII 
estimate 


15,068,463 
13,571,329 
11,939,333 

9,654,724 

8,891,860 
14,605,994 
10,498,839 


84,230,542 


CSFII 
percent 


86.2% 
13.8% 


100.0% 


CSFII 
percent 


91.5% 
8.5% 


100.0% 


CSFII 
percent 


23.1% 
24.3% 
27.6% 
25.1% 


100.0% 


CSFII 
percent 


17.9% 
16.1% 
14.2% 
11.5% 
10.6% 
17.3% 
12.5% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


83,742,215 
11,458,994 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


87,166,480 
8,034,729 


95,201,209 


Final (post- 
raked) CSFII 
estimate 


23,800,300 
23,800,300 
23,800,299 
23,800,310 


95,201,209 


Final (post- 
raked) CSFIL 
estimate 


13,600,174 
13,600,172 
13,600,172 
13,600,173 
13,600,171 
13,600,173 
13,600,175 


95,201,209 


March 1994 
CPS 


83,742,214 
11,458,995 


95,201,209 


March 1994 
CPS 


87,166,480 
8,034,729 


95,201,209 


March 1994 
CPS 


23,800,302 
23,800,302 
23,800,302 
23,800,302 


95,201,208 


March 1994 
CPS 


13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 


95,201,208 


CPS 
percent 


88.0% 
12.0% 


100.0% 


CPS 
percent 


91.6% 
8.4% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to CSFII 


1215 
0.98 


1713 


Ratio CPS 
to CSFII 


1313 
1.13 


1.13 


Ratio CPS 
to CSFII 


1.22 
1.16 
1.03 
1.13 


1.13 


Ratio CPS 
to CSFII 


0.90 
1.00 
1.14 
1.41 
1.53 
0.93 
1.30 


1.13 


ARS Subset 3 (children 0-5 years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables 


Total 


DIM12 


hwWW RK 


Total 


DIM2 


Total 


DIM3 


Total 


DIM5 


Total 


PS_MSA 
(METRO) 


1 (MSA) 
2 (non-MSA) 


REGION 


1 Northeast 
2 Midwest 
3 South 

4 West 


KID17 


0 (no) 
1 (yes) 


ADULT1 


0 (no) 
0 (no) 
1 (yes) 


HEADJOB 


0 (no) 
1 (yes) 


CSFII 
sample size 
(Day 1 
resp.) 


942 
285 


1,227 


CSFII 
sample size 
(Day 1 
resp.) 


208 
298 
403 
318 


1,227 


CSFII 
sample size 
(ay 1 
resp.) 


681 
546 


1,227 


CSFII 
sample size 
(Day 1 


ADULT2 resp.) 


167 
877 
183 


0 (no) 


1 (yes) 
0 (no) 


L220 


CSFII 
sample size 
(Day 1 
resp.) 


553 
674 


1,227 


Pre-raked 
CSFII 
estimate 


15,842,541 
4,541,659 


20,384,200 


Pre-raked 
CSFII 
estimate 


3,503,027 
4,949,474 
6,634,886 
5,296,814 


20,384,200 


Pre-raked 
CSFII 
estimate 


11,066,011 
9,318,189 


20,384,200 


Pre-raked 
CSFII 
estimate 


2,858,976 
14,591,866 
2,933,358 


20,384,200 


Pre-raked 
CSFII 
estimate 


9,082,176 
11,302,024 


20,384,200 


CSFII 
percent 


71.7% 
22.3% 


100.0% 


CSFIL 
percent 


17.2% 
24.3% 
32.5% 
26.0% 


100.0% 


CSFII 
percent 


54.3% 
45.7% 


100.0% 


CSFII 
percent 


14.0% 
71.6% 
14.4% 


100.0% 


CSFII 
percent 


44.6% 
55.4% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


19,833,488 
4,606,805 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


4,588,209 
5,815,338 
8,201,632 
5,835,114 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


13,497,786 
10,942,508 


24,440,293 


Final (post- 
raked) CSF 
estimate 


3,321,837 
17,529,408 
3,589,048 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


11,369,615 
13,070,678 


24,440,293 


March 1994 
CPS 


19,833,484 
4,606,809 


24,440,293 


March 1994 
CPS 


4,588,209 
3,8155335 
8,201,630 
5,035,019 


24,440,293 


March 1994 
CPS 


13,497,810 
10,942,483 


24,440,293 


March 1994 
CPS 


3,321,819 
17,529,496 
3,588,979 


24,440,293 


March 1994 
CPS 


11,369,535 
13,070,758 


24,440,293 


CPS 
percent 


81.2% 
18.8% 


100.0% 


CPS 
percent 


18.8% 
23.8% 
33.6% 
23.9% 


100.0% 


CPS 
percent 


55.2% 
44.8% 


100.0% 


CPS 
percent 


13.6% 
71.7% 
14.7% 


100.0% 


CPS 
percent 


46.5% 
53.5% 


100.0% 


Ratio CPS 
to CSFII 


1.25 
1.01 


120 


Ratio CPS 
to CSFII 


eo 
1.17 
1.24 
1.10 


1.20 


Ratio CPS 
to CSFII 


1.22 
alg 


Ratio CPS 
to CSFII 


1.16 
1.20 
1.22 


1.20 


Ratio CPS 
to CSFII 


125 
LO 


1.20 


ARS Subset 3 (children 0-5 years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM6 


hWN eR 


Total 


DIM4 


AWW — 


Total 


Total 


CSFII 
sample size 
(Day 1 
POVGRP resp.) 
1 (0-75%) 255 
2 (76-130%) 175 
3 (131-300%) 435 
4 (301%+) 362 
eo, 
CSFII 
sample size 
(Day 1 
STAMP12 resp.) 
0 (no) 893 
1 (yes) 334 
W227 
CSFII 
sample size 
(Day 1 
OWNHOME resp.) 
0 (no) 540 
1 (yes) 687 
227 
CSFII 
sample size 
(Day 1 
SEX AGEGRP resp.) 
1 ™) 1 (0-2 yrs) 311 
1 ™) 2 (3-5 yrs) 299 
2® 1 (0-2 yrs) 314 
2® 2 G-5 yrs) 303 
W220i; 
CSFII 
sample size 
(ay 1 
BLACK resp.) 
0 (no) 1,048 
1 (yes) 179 
W227 


Pre-raked 
CSFII 
estimate 


3,952,451 
2,706,821 
7,580,151 
6,144,778 


20,384,200 


Pre-raked 
CSFII 
estimate 


15,215,741 
5,168,459 


20,384,200 


Pre-raked 
CSFII 
estimate 


8,768,651 
11,615,549 


20,384,200 


Pre-raked 
CSFII 
estimate 


4,505,882 
5,644,612 
4,578,360 
5,655,346 


20,384,200 


Pre-raked 
CSFII 
estimate 


17,449,251 
2,934,949 


20,384,200 


CSF 
percent 


19.4% 
13.3% 
37.2% 
30.1% 


100.0% 


CSFI 
percent 


74.6% 
25.4% 


100.0% 


CSFII 
percent 


43.0% 
57.0% 


100.0% 


CSF 
percent 


22.1% 
27.7% 
22.5% 
27.7% 


100.0% 


CSFII 
percent 


85.6% 
14.4% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


4,575,003 
3,401,673 
8,557,287 
7,906,330 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


18,334,944 
6,105,349 


24,440,293 


Final (post- 
raked) CSF 
estimate 


11,331,324 
13,108,969 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


6,237,967 
6,258,218 
5,962,548 
5,981,561 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


20,412,314 
4,027,979 


24,440,293 


March 1994 
CPS 


4,574,918 
3,401,650 
8,557,324 
7,906,401 


24,440,293 


March 1994 
CPS 


18,334,962 
6,105,332 


24,440,293 


March 1994 
CPS 


Pes3ie Stil 
13,108,983 


24,440,293 


March 1994 
CPS 


6,237,955 
6,258,221 
D39625552 
5,981,566 


24,440,293 


March 1994 
CPS 


20,412,310 
4,027,983 


24,440,293 


CPS 
percent 


18.7% 
13.9% 
35.0% 
32.3% 


100.0% 


CPS 
percent 


75.0% 
25.0% 


100.0% 


CPS 
percent 


46.4% 
53.6% 


100.0% 


CPS 
percent 


25.5% 
25.6% 
24.4% 
24.5% 


100.0% 


CPS 
percent 


83.5% 
16.5% 


100.0% 


Ratio CPS 
to CSFII 


1.16 
1.26 
Wales 
1229) 


1.20 


Ratio CPS 
to CSFII 


1.20 
1.18 


1.20 


Ratio CPS 
to CSFII 


1.29 
1.13 


1.20 


Ratio CPS 
to CSFII 


1.38 
1G 
1.30 
1.06 


1.20 


Ratio CPS 
to CSFII 


1.20 


ARS Subset 3 (children 0-5 years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM13 HISPANIC 
1 0 (no) 
2 1 (yes) 
Total 
DIM10 SEASON 
il 1 (Winter) 
22 2 (Spring) 
3 3 (Summer) 
4 4 (Fall) 
Total 
DIM11 DAY_ITK 
1 1 (Sunday) 
2 2 (Monday) 
3 3 (Tuesday) 
4 4 (Wednesday) 
5 5: (Thursday) 
6 6 (Friday) 
ch 7 (Saturday) 
Total 


CSFII 
sample size 
(Day 1 
resp.) 


1,030 
197 


1,227 


CSFII 
sample size 
(Day 1 
resp.) 


309 
298 
317 
303 


1227, 


CSFII 
sample size 
(Day 1 
resp.) 


205 
179 
211 
147 
139 
196 
150 


Mereag 


Pre-raked 
CSFII 
estimate 


17,065,789 
3,318,411 


20,384,200 


Pre-raked 
CSFII 
estimate 


5,103,324 
4,832,633 
5,261,662 
5,186,582 


20,384,200 


Pre-raked 
CSFII 
estimate 


3,359,368 
3,055,226 
3,477,351 
2,463,210 
2,320,585 
3,246,953 
2,461,507 


20,384,200 


CSFII 
percent 


83.7% 
16.3% 


100.0% 


CSFII 
percent 


25.0% 
23.7% 
25.8% 
25.4% 


100.0% 


CSF 
percent 


16.5% 
15.0% 
17.1% 
12.1% 
11.4% 
15.9% 
12.1% 


100.0% 


Final (post- 
raked) CSFII 
estimate 


20,721,303 
3,718,990 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


6,110,073 
6,110,072 
6,110,073 
6,110,075 


24,440,293 


Final (post- 
raked) CSFII 
estimate 


3,491,470 
3,491,472 
3,491,469 
3,491,473 
3,491,469 
3,491,471 
3,491,469 


24,440,293 


March 1994 
CPS 


20,721,303 
3,718,990 


24,440,293 


March 1994 
CPS 


6,110,073 
6,110,073 
6,110,073 
6,110,073 


24,440,293 


March 1994 
CPS 


3,491,470 
3,491,470 
3,491,470 
3,491,470 
3,491,470 
3,491,470 
3,491,470 


24,440,293 


CPS 
percent 


84.8% 
15.2% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to CSFII 


eZ 
ihe) 


1.20 


Ratio CPS 
to CSFII 


1.20 
1.26 
1.16 
1.18 


1.20 


Ratio CPS 
to CSFII 


1.04 
1.14 
1.00 
1.42 
1.50 
1.08 
1.42 


1.20 


ARS Subset 4 (children 6-19 years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables 


DIM1 


Ne 


Total 


DIM12 


Pp WW re 


Total 


Total 


DIM3 


WW re 


Total 


PS MSA 
(METRO) 


1 (MSA) 
2 (non-MSA) 


REGION 
1 Northeast 
2 Midwest 


3 South 
4 West 


KIDS 


0 (no) 
1 (yes) 


KID17 


0 (no) 
1 (yes) 


ADULT1 


0 (no) 
0 (no) 
1 (yes) 


CSFII 
sample size 
(Day 1 
resp.) 


782 
289 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


150 
285 
361 
275 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


768 
303 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


60 
1,011 


1,071 


CSFII 
sample size 
(Day 1 


ADULT2 resp.) 


0 (no) 269 
1 (yes) 663 
0 (no) 139 


1,071 


Pre-raked 
CSFII 
estimate 


35,167,730 
11,394,382 


46,562,111 


Pre-raked 
CSFII 
estimate 


6,504,943 
11,941,987 
16,562,481 
11,552,702 


46,562,111 


Pre-raked 
CSFII 
estimate 


34,310,829 
12,251,283 


46,562,111 


Pre-raked 
CSFII 
estimate 


2,839,662 
43,722,450 


46,562,111 


Pre-raked 
CSFII 
estimate 


13,163,966 
28,174,549 
5,223,597 


46,562,111 


CSFII 
percent 


75.5% 
24.5% 


100.0% 


CSFII 
percent 


14.0% 
25.6% 
35.6% 
24.8% 


100.0% 


CSFII 
percent 


73.7% 
26.3% 


100.0% 


CSFII 
percent 


6.1% 
93.9% 


100.0% 


CSFII 
percent 


28.3% 
60.5% 
11.2% 


100.0% 


“0- 


Final (post- 
raked) CSFII 
estimate 


40,409,847 
11,791,465 


$2,201,312 


Final (post- 
raked) CSFII 
estimate 


9,649,874 
12,576,503 
18,185,011 
11,789,926 


2.201 ,a12 


Final (post- 
raked) CSFII 
estimate 


38,035,548 
14,165,764 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


SEL EE 
48,602,590 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


13,466,808 
30,667,213 
8,067,292 


52,201,312 


March 1994 
CPS 


40,409,882 
11,791,431 


$2,201,312 


March 1994 
CPS 


9,649,878 
12,576,495 
18,185,004 
11,789,936 


5252015312 


March 1994 
CPS 


38,035,548 
14,165,764 


S220 Se 


March 1994 
CPS 


3,598,715 
48,602,598 


5252015312 


March 1994 
CPS 


13,466,818 
30,667,255 
8,067,239 


52,201,312 


CPS 
percent 


71.4% 
22.6% 


100.0% 


CPS 
percent 


18.5% 
24.1% 
34.8% 
22.6% 


100.0% 


CPS 
percent 


72.9% 
27.1% 


100.0% 


CPS 
percent 


6.9% 
93.1% 


100.0% 


CPS 
percent 


25.8% 
58.7% 
15.5% 


100.0% 


Ratio CPS 
to CSFII 


11S 
1.03 


1h) 


Ratio CPS 
to CSFII 


1.48 
1.05 
1.10 
1.02 


Rene 


Ratio CPS 
to CSFII 


1.11 
1.16 


Te1zZ 


Ratio CPS 
to CSFII 


2H 
Ty! 


1.12 


Ratio CPS 
to CSFII 


1.02 
1.09 
1.54 


1) 2 


ARS Subset 4 (children 6-19 years old) 
Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIMS5 


VN eK 


Total 


DIM6 


kk WW 


Total 


DIM7 


Total 


DIM8 


Total 


DIM4 


WW eR 


Total 


HEADJOB 


0 (no) 
1 (yes) 


POVGRP 
1 (0-75 %) 
2 (76-130%) 


3 (131-300%) 
4 (301% +) 


STAMP12 


0 (no) 
1 (yes) 


OWNHOME 


0 (no) 
1 (yes) 


AGEGRP 


3 (6-11 yrs) 
4 (12-19 yrs) 
3 (6-11 yrs) 
4 (12-19 yrs) 


CSFII 
sample size 
(Day 1 


resp.) 


368 
703 


1,071 


CSFII 
sample size 
(Day 1 


resp.) 


173 
124 
407 
367 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


887 
184 


1,071 


CSFII 
sample size 
(Day 1 


resp.) 


349 
722 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


254 
286 
260 
271 


1,071 


Pre-raked 
CSFII 
estimate 


15,185,444 
31,376,668 


46,562,111 


Pre-raked 
CSFII 
estimate 


5,863,627 
4,418,544 
18,361,062 
17,918,878 


46,562,111 


Pre-raked 
CSFII 
estimate 


39,984,410 
6,577,702 


46,562,111 


Pre-raked 
CSFII 
estimate 


13,422,737 
33,139,375 


46,562,111 


Pre-raked 
CSFII 
estimate 


9,938,185 
14,157,596 
9 55325) 
12,871,005 


46,562,111 


CSFII 
percent 


32.6% 
67.4% 


100.0% 


CSFII 
percent 


12.6% 

9.5% 
39.4% 
38.5% 


100.0% 


CSFI 
percent 


85.9% 
14.1% 


100.0% 


CSFII 
percent 


28.8% 
71.2% 


100.0% 


CSFII 
percent 


21.3% 
30.4% 
20.6% 
27.6% 


100.0% 


Fri 


Final (post- 
raked) CSFII 
estimate 


18,632,878 
33,568,435 


S2s20le se 


Final (post- 
raked) CSFII 
estimate 


7,512,710 
6,306,186 
18,436,763 
19,945 ,653 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


43,155,739 
9,045 ,574 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


17,632,268 
34,569,044 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


11,860,822 
14,775,578 
11,296,815 
14,268,098 


S2,20lnai2 


March 1994 
CPS 


18,632,794 
33,568,519 


52,2015312 


March 1994 
CPS 


sol 2731 
6,306,194 
18,436,769 
19,945,618 


S2,201es 12) 


March 1994 
CPS 


43,155,714 
9,045,599 


52,201,312 


March 1994 
CPS 


17,632,281 
34,569,031 


52,201,312 


March 1994 
CPS 


11,860,832 
14,775,576 
11,296,811 
14,268,094 


SZ,201312 


CPS 
percent 


35.7% 
64.3% 


100.0% 


CPS 
percent 


14.4% 
12.1% 
35.3% 
38.2% 


100.0% 


CPS 
percent 


82.7% 
17.3% 


100.0% 


CPS 
percent 


33.8% 
66.2% 


100.0% 


CPS 
percent 


22.7% 
28.3% 
21.6% 
27.3% 


100.0% 


Ratio CPS 
to CSFII 


1.23 
1.07 


ysl 


Ratio CPS 
to CSFII 


1.28 
1.43 
1.00 
ite ts 


112 


Ratio CPS 
to CSFII 


1.08 
1.38 


it 


Ratio CPS 
to CSFII 


3 
1.04 


ible? 


Ratio CPS 
to CSFII 


eile, 
1.04 
1.18 
1.11 


js 22 


ARS Subset 4 (children 6-19 years old) 


Comparison of Weighted CSFII and CPS Totals by Raking Variables (Continued) 


DIM9 BLACK 
1 0 (no) 
2 1 (yes) 
Total 
DIM13 HISPANIC 
i 0 (no) 
2 1 (yes) 
Total 
DIM10 SEASON 
1 1 (Winter) 
2 2 (Spring) 
3 3 (Summer) 
4 4 (Fall) 
Total 
DIM11 DAY_ITK 
1 1 (Sunday) 
2 2 (Monday) 
3 3 (Tuesday) 
4 4 (Wednesday) 
5 5 (Thursday) 
6 6 (Friday) 
a 7 (Saturday) 
Total 


CSFII 
sample size 
(Day 1 
resp.) 


929 
142 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


912 
159 


1,071 


CSFII 
sample size 
(Day 1 
resp.) 


Zo2 
251 
281 
247 


1,071 


CSFII 
sample size 
(ay 1 
resp.) 


160 
175 
166 
161 
114 
171 
124 


1,071 


Pre-raked 
CSFII 
estimate 


39,723,989 
6,838,123 


46,562,111 


Pre-raked 
CSFII 
estimate 


40,253,457 
6,308,654 


46,562,111 


Pre-raked 
CSFII 
estimate 


12,349,285 
10,512,143 
13,179,153 
10,521,531 


46,562,111 


Pre-raked 
CSFII 
estimate 


6,781,498 
7,401,596 
7,087,783 
6,578,128 
5,541,731 
7,347,977 
5,823,398 


46,562,111 


CSFII 
percent 


85.3% 
14.7% 


100.0% 


CSFII 
percent 


86.5% 
13.5% 


100.0% 


CSFII 
percent 


26.5% 
22.6% 
28.3% 
22.6% 


100.0% 


CSFII 
percent 


14.6% 
15.9% 
15.2% 
14.1% 
11.9% 
15.8% 
12.5% 


100.0% 


=l2= 


Final (post- 
raked) CSFII 
estimate 


43,938,676 
8,262,636 


52,201,312 


Final (post- 
raked) CSF 
estimate 


45,486,408 
6,714,905 


S220 1E3 12 


Final (post- 
raked) CSFII 
estimate 


13,050,329 
13,050,331 
13,050,330 
13,050,323 


52,201,312 


Final (post- 
raked) CSFII 
estimate 


7,457,330 
7,457,332 
7,457,329 
7,457,332 
7,457,331 
7,457,331 
7,457,328 


52,201,312 


March 1994 
CPS 


43 ,938,676 
8,262,637 


52,201,313 


March 1994 
CPS 


45,486,405 
6,714,908 


52,201,312 


March 1994 
CPS 


13,050,328 
13,050,328 
13,050,328 
13,050,328 


52,201,312 


March 1994 
CPS 


7,457,330 
7,457,330 
7,457,330 
7,457,330 
7,457,330 
7,457,330 
7,457,330 


52,201,312 


CPS 
percent 


84.2% 
15.8% 


100.0% 


CPS 
percent 


87.1% 
12.9% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to CSFII 


Pelt 
1.21 


E12 


Ratio CPS 
to CSFII 


els 
1.06 


1.12 


Ratio CPS 
to CSFII 


1.06 
1.24 
0.99 
1.24 


1.12 


Ratio CPS 
to CSFII 


1.10 
1.01 
1.05 
1313 
1:35 
1.01 
1.28 


tbs 


DHKS Weights 
ARS Subset 1 (males 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables 


DIM1 


DIM2 


AWN eS 


Total 


DIM3 


Total 


PS_MSA 
(METRO) 
1 (MSA) 
2 (non-MSA) 
REGION 
1 Northeast 
2 Midwest 
3 South 
4 West 
KIDS KID17 
0 (no) 0 (no) 
0 (no) 1 (yes) 
1 (yes) 0 (no) 
1 (yes) 1 (yes) 
ADULT1 ADULT2 
0 (no) 0 (no) 
0 (no) 1 (yes) 
1 (yes) 0 (no) 


DHKS 
sample size 
(resp.) 


639 
263 


902 


DHKS 
sample size 
(resp.) 


162 
218 
317 
205 


902 


DHKS 
sample size 
(resp.) 


589 
168 
75 
70 


902 


DHKS 
sample size 
(resp.) 


158 
565 
179 


902 


Pre-raked 
DHKS 
estimate 


53,442,853 
16,047,767 


69,490,620 


Pre-raked 
DHKS 
estimate 


11,633,521 
16,119,590 
25,601,340 
16,136,170 


69,490,620 


Pre-raked 
DHKS 
estimate 


41,307,057 
14,790,831 
7,204,574 
6,188,159 


69,490,620 


Pre-raked 
DHKS 
estimate 


15,353 ,988 
45,798,652 
8,337,980 


69,490,620 


See 


DHKS 
percent 


76.9% 
23.1% 


100.0% 


DHKS 
percent 


16.7% 
23.2% 
36.8% 
23.2% 


100.0% 


DHKS 
percent 


59.4% 
21.3% 
10.4% 

8.9% 


100.0% 


DHKS 
percent 


22.1% 
65.9% 
12.0% 


100.0% 


March 1994 
CPS 


69,090,997 
18,573,440 


87,664,437 


March 1994 
CPS 


17,566,644 
20,409,459 
30,230,680 
19,457,654 


87,664,437 


March 1994 
CPS 


53,526,302 
17,597,810 
8,680,549 
7,859,777 


87,664,437 


March 1994 
CPS 


25,283,442 
52,305,892 
10,075,103 


87,664,437 


CPS 
percent 


78.8% 
21.2% 


100.0% 


CPS 
percent 


20.0% 
23.3% 
34.5% 
22.2% 


100.0% 


CPS 
percent 


61.1% 
20.1% 
9.9% 
9.0% 


100.0% 


CPS 
percent 


28.8% 
59.7% 
11.5% 


100.0% 


Ratio CPS 
to DHKS 


129 
1.16 


1.26 


Ratio CPS 
to DHKS 


51 
E27, 
1.18 
1.21 


1.26 


Ratio CPS 
to DHKS 


Ratio CPS 
to DHKS 


1.65 
1.14 
1.21 


1.26 


DHKS Weights 
ARS Subset 1 (males 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables (Continued) 


DHKS Pre-raked 
sample size DHKS DHKS March 1994 CPS Ratio CPS 
DIM4 FH40 (resp.) estimate percent CPS percent to DHKS 
1 0 (no) 848 62,989,308 90.6% 81,267,770 92.7% 129 
2 1 (yes) 54 6,501,312 9.4% 6,396,667 7.3% 0.98 
Total 902 69,490,620 100.0% 87,664,437 100.0% 1.26 
DHKS Pre-raked 
sample size DHKS DHKS March 1994 CPS Ratio CPS 
DIMS5 HAVEJOB (resp.) estimate percent CPS percent to DHKS 
1 0 (no) 314 17,110,248 24.6% 26,478,525 30.2% 1.55 
1 (yes) 588 52,380,372 75.4% 61,185,912 69.8% Ne 
Total 902 69,490,620 100.0% 87,664,437 100.0% 1.26 
DHKS Pre-raked 
sample size DHKS DHKS March 1994 CPS Ratio CPS 
DIM6 POVGRP (resp.) estimate percent CPS percent to DHKS 
1 1 (0-75%) 86 3,787,634 5.5% 4,572,820 5.2% 21 
2 2 (76-130%) 142 5,496,247 7.9% 7,120,844 8.1% 1.30 
3 3 (131-300%) 283 23,939,585 34.5% 28,000,514 31.9% NG) 
4 4 301% +) 391 36,267,154 52.2% 47,970,259 54.7% 1:32 
Total 902 69,490,620 100.0% 87,664,437 100.0% 1.26 
DHKS Pre-raked 
sample size DHKS DHKS March 1994 CPS Ratio CPS 
DIM7 STAMP 12 (resp.) estimate percent CPS percent to DHKS 
1 0 (no) 815 65,436,764 94.2% 82,025,625 93.6% 1.25 
2 1 (yes) 87 4,053,856 5.8% 5,638,812 6.4% 1.39 
Total 902 69,490,620 100.0% 87,664,437 100.0% 1.26 
DHKS Pre-raked 
sample size DHKS DHKS March 1994 CPS Ratio CPS 
DIM8 OWNHOME AGEGRP (resp.) estimate percent CPS percent to DHKS 
1 0 (no) 5&6 (20-39) 145 13,876,468 20.0% 17,768,207 20.3% 1.28 
2 0 (no) 7 (40-59) 91 4,307,493 6.2% 6,556,231 7.5% 1.52 
3 0 (no) 8&9 (60+) 47 1,814,216 2.6% 2,669,630 3.0% 1.47 
4 1 (yes) 5&6 (20-39) 159 19,062,149 27.4% 23,152,149 26.4% 121 
5 1 (yes) 7 (40-59) 236 18,626,180 26.8% 22,670,937 25.9% 22 
6 1 (yes) 8&9 (60+) 224 11,804,115 17.0% 14,847,284 16.9% 1.26 
Total 902 69,490,620 100.0% 87,664,437 100.0% 1.26 


Bia. 


DHKS Weights 


ARS Subset 1 (males 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables (Continued) 


DIM9 (new) BLACK 


1 0 (mo) 
2 1 (yes) 
Total 
DIM13 


(new) HISPANIC 


1 0 (no) 
1 (yes) 


Total 


DIM10 SEASON 


1 1 (Winter) 

Z 2 (Spring) 

3 3 (Summer) 

4 4 (Fall) 
Total 


DIM11 _—‘DAY_ITK 


1 (Sunday) 

2 (Monday) 

3 (Tuesday) 

4 (Wednesday) 
5 (Thursday) 
6 (Fnday) 

7 (Saturday) 


NADU AWN 


Total 


DHKS 
sample size 
(resp.) 


800 
102 


902 


DHKS 
sample size 


(resp.) 


822 
80 


902 


DHKS 
sample size 
(resp.) 


194 
235 
246 
227 


902 


DHKS 
sample size 
(resp.) 


149 
140 
134 
113 

86 
158 
122 


902 


Pre-raked 
DHKS 
estimate 


60,787,042 
8,703,578 


69,490,620 


Pre-raked 
DHKS 


estimate 


63,858,914 
5,631,705 


69,490,620 


Pre-raked 
DHKS 
estimate 


14,646,621 
19,091,770 
19,464,317 
16,287,912 


69,490,620 


Pre-raked 
DHKS 
estimate 


11,626,777 
10,124,544 
10,232,938 
9,127,974 
7,059,892 
11,881,445 
9,437,049 


69,490,620 


“Ee 


DHKS 
percent 


87.5% 
12.5% 


100.0% 


DHKS 
percent 


91.9% 
8.1% 


100.0% 


DHKS 
percent 


21.1% 
27.5% 
28.0% 
23.4% 


100.0% 


DHKS 
percent 


16.7% 
14.6% 
14.7% 
13.1% 
10.2% 
17.1% 
13.6% 


100.0% 


March 1994 
CPS 


78,419,903 
9,244,534 


87,664,437 


March 1994 
CPS 


79,524,332 
8,140,105 


87,664,437 


March 1994 
CPS 


21,916,109 
21,916,109 
21,916,109 
21,916,109 


87,664,437 


March 1994 
CPS 


12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 
12,523,491 


87,664,437 


CPS 
percent 


89.5% 
10.5% 


100.0% 


CPS 
percent 


90.7% 
9.3% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to DHKS 


1.29 
1.06 


1.26 


Ratio CPS 
to DHKS 


2S 
1.45 


1.26 


Ratio CPS 
to DHKS 


1.50 
LS 
HGH) 
1.35 


1.26 


Ratio CPS 
to DHKS 


1.08 
1.24 
ie 
1.37 
sea 
1.05 
133 


1.26 


DHKS Weights 
ARS Subset 2 (females 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables 


Total 


DIM12 
(new) 


hW We 


Total 


DIM2 


hWN 


Total 


DIM3 


On — 


Total 


PS_MSA 
(METRO) 
1 (MSA) 
2 (non-MSA) 
REGION 
1 Northeast 
2 Midwest 
3 South 
4 West 
KIDS KID17 
0 (no) 0 (no) 
0 (no) 1 (yes) 
1 (yes) 0 (no) 
1 (yes) 1 (yes) 
ADULT1 ADULT2 
0 (no) 0 (no) 
0 (no) 1 (yes) 
1 (yes) 0 (no) 


DHKS 
sample size 
(resp.) 


722 
255 


977 


DHKS 
sample size 
(resp.) 


201 
286 
328 
162 


977 


DHKS 
sample size 
(resp.) 


619 
199 
18 
86 


O77. 


DHKS 
sample size 
(resp.) 


150 
491 
336 


977 


Pre-raked 
DHKS 
estimate 


66,390,267 
21,064,782 


87,455,049 


Pre-raked 
DHKS 
estimate 


18,231,443 
24,052,768 
29,491,362 
15,679,476 


87,455,049 


Pre-raked 
DHKS 
estimate 


49,740,840 
20,513,060 
8,046,033 
9,155,116 


87,455,049 


Pre-raked 
DHKS 
estimate 


19,237,979 
51,680,608 
16,536,462 


87,455,049 


E16- 


DHKS 
percent 


75.9% 
24.1% 


100.0% 


DHKS 
percent 


20.8% 
27.5% 
33.7% 
17.9% 


100.0% 


DHKS 
percent 


56.9% 
23.5% 

9.2% 
10.5% 


100.0% 


DHKS 
percent 


22.0% 
59.1% 
18.9% 


100.0% 


March 1994 
CPS 


74,920,030 
20,281,179 


95,201,209 


March 1994 
CPS 


19,685,799 
22,383,178 
33,189,842 
19,942,391 


95,201,209 


March 1994 
CPS 


54,506,862 
20,649,674 
10,444,403 

9,600,271 


95,201,209 


March 1994 
CPS 


22,062,595 
53,357,195 
19,781,419 


95,201,209 


CPS 
percent 


78.7% 
21.3% 


100.0% 


CPS 
percent 


20.7% 
23.5% 
34.9% 
20.9% 


100.0% 


CPS 
percent 


57.3% 
21.7% 
11.0% 
10.1% 


100.0% 


CPS 
percent 


23.2% 
56.0% 
20.8% 


100.0% 


Ratio CPS 
to DHKS 


1.13 
0.96 


1.09 


Ratio CPS 
to DHKS 


1.08 
0.93 
3 
1.27 


1.09 


Ratio CPS 
to DHKS 


1.10 
1.01 
1.30 
1.05 


1.09 


Ratio CPS 
to DHKS 


Pets 
1.03 
1.20 


1.09 


DHKS Weights 
ARS Subset 2 (females 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables (Continued) 


DIM4 


Total 


Total 


DIM6 


kwWN re 


Total 


DIM7 


Total 


DIM8 


Dn BWNY 


Total 


FH40 


0 (no) 
1 (yes) 


HAVEJOB 


0 (no) 
1 (yes) 


POVGRP 


1 (0-75 %) 

2 (76-130%) 
3 (131-300%) 
4 (301% +) 


STAMP12 


0 (no) 
1 (yes) 


OWNHOME 


0 (no) 
0 (no) 
0 (no) 
1 (yes) 
1 (yes) 
1 (yes) 


AGEGRP 


5&6 (20-39) 
7 (40-59) 
8&9 (60+) 
5&6 (20-39) 
7 (40-59) 
8&9 (60+) 


DHKS 
sample size 
(resp.) 


881 
96 


OUT 


DHKS 
sample size 
(resp.) 


484 
493 


SUT 


DHKS 
sample size 
(resp.) 


146 
138 
313 
380 


977 


DHKS 
sample size 
(resp.) 


848 
129 


977 


DHKS 
sample size 
(resp.) 


180 
95 
66 

138 

261 

235i 


977 


Pre-raked 
DHKS 
estimate 


75,847,311 
11,607,738 


87,455,049 


Pre-raked 
DHKS 
estimate 


37,174,780 
50,280,269 


87,455,049 


Pre-raked 
DHKS 
estimate 


7,355,428 
7,579,340 
30,428,899 
42,091,382 


87,455,049 


Pre-raked 
DHKS 
estimate 


79,900,271 
7,554,778 


87,455,049 


Pre-raked 
DHKS 


estimate 


18,439,110 
4,644,101 
3,500,949 

20,265,701 

23,493,634 

17,111,553 


87,455,049 


ibe 


DHKS 
percent 


86.7% 
13.3% 


100.0% 


DHKS 
percent 


42.5% 
57.5% 


100.0% 


DHKS 
percent 


8.4% 
8.7% 
34.8% 
48.1% 


100.0% 


DHKS 
percent 


91.4% 
8.6% 


100.0% 


DHKS 
percent 


21.1% 
5.3% 
4.0% 

23.2% 

26.9% 

19.6% 


100.0% 


March 1994 
CPS 


84,992,079 
10,209,130 


95,201,209 


March 1994 
CPS 


42,385,196 
52,816,013 


95,201,209 


March 1994 
CPS 


8,479,573 
10,477,066 
30,970,034 
45,274,536 


95,201,209 


March 1994 
CPS 


85,347,070 
9,854,140 


95,201,209 


March 1994 
CPS 


18,627,631 
6,845,428 
4,887,770 

22,794,198 

23m 2e922 

18,333,661 


95,201,209 


CPS 
percent 


89.3% 
10.7% 


100.0% 


CPS 
percent 


44.5% 
55.5% 


100.0% 


CPS 
percent 


8.9% 
11.0% 
32.5% 
47.6% 


100.0% 


CPS 
percent 


89.6% 
10.4% 


100.0% 


CPS 
percent 


19.6% 
7.2% 
5.1% 

23.9% 

24.9% 

19.3% 


100.0% 


Ratio CPS 
to DHKS 


1.12 
0.88 


1.09 


Ratio CPS 
to DHKS 


1.14 
1.05 


1.09 


Ratio CPS 
to DHKS 


1.15 
1.38 
1.02 
1.08 


1.09 


Ratio CPS 
to DHKS 


1.07 
1.30 


1.09 


Ratio CPS 
to DHKS 


1.01 
1.47 
1.40 
Welz 
1.01 
1.07 


1.09 


DHKS Weights 


ARS Subset 2 (females 20+ years old) 
Comparison of Weighted DHKS and CPS Totals by Raking Variables (Continued) 


DIM9 (new) BLACK 
1 0 (no) 
2 1 (yes) 
Total 
DIM13 


(new) HISPANIC 


1 0 (mo) 
2 1 (yes) 
Total 
DIM10 SEASON 
1 1 (Winter) 
2 2 (Spring) 
3 3 (Summer) 
4 4 (all) 
Total 
DIM11 DAY_ITK 
1 1 (Sunday) 
2 2 (Monday) 
3 3 (Tuesday) 
4 4 (Wednesday) 
5 5 (Thursday) 
6 6 (Friday) 
7 7 (Saturday) 


Total 


DHKS 
sample size 
(resp.) 


847 
130 


977 


DHKS 
sample size 
(resp.) 


895 
82 


977 


DHKS 
sample size 
(resp.) 


239 
231 
255 
252 


977 


DHKS 
sample size 
(resp.) 


180 
155 
145 
110 

97 
170 
120 


977 


Pre-raked 
DHKS 
estimate 


76,529,592 
10,925,457 


87,455,049 


Pre-raked 
DHKS 
estimate 


80,583,289 
6,871,760 


87,455,049 


Pre-raked 
DHKS 
estimate 


20,498,795 
19,761,687 
23,901,960 
23,292,607 


87,455,049 


Pre-raked 
DHKS 
estimate 


15,382,366 
13,326,115 
11,836,194 

9,724,149 
10,212,706 
16,458,408 
10,515,111 


87,455,049 


-18- 


DHKS 
percent 


87.5% 
12.5% 


100.0% 


DHKS 
percent 


92.1% 
7.9% 


100.0% 


DHKS 
percent 


23.4% 
22.6% 
27.3% 
26.6% 


100.0% 


DHKS 
percent 


17.6% 
15.2% 
13.5% 
11.1% 
11.7% 
18.8% 
12.0% 


100.0% 


March 1994 
CPS 


83,742,214 
11,458,995 


95,201,209 


March 1994 
CPS 


87,166,480 
8,034,728 


95,201,208 


March 1994 
CPS 


23,800,302 
23,800,302 
23,800,302 
23,800,302 


95,201,208 


March 1994 
CPS 


13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 
13,600,173 


95,201,208 


CPS 
percent 


88.0% 
12.0% 


100.0% 


CPS 
percent 


91.6% 
8.4% 


100.0% 


CPS 
percent 


25.0% 
25.0% 
25.0% 
25.0% 


100.0% 


CPS 
percent 


14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 
14.3% 


100.0% 


Ratio CPS 
to DHKS 


1.09 
1.05 


1.09 


Ratio CPS 
to DHKS 


1.08 
aay 


1.09 


Ratio CPS 
to DHKS 


1.16 
1.20 
1.00 
1.02 


1.09 


Ratio CPS 
to DHKS 


0.88 
1.02 
IptS 
1.40 
1.33 
0.83 
1.29 


1.09 


3.A CSFII/DHKS 1994 Data Collection 


Instruments 
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OMB #: 0586-0014 
Expires: October 31, 1996 


WHAT WE EAT IN AMERICA: 1994-1996 
SCREENER 


CASE #: 


ADDRESS: 


MISSED STRUCTURE: 
MISSED DU: 
CONTACT DAYS 


SAMPLE MESSAGE: 


INTRODUCTION: Hello, ’'m (YOUR NAME) and we are conducting a survey for the United States 
Department of Agriculture. A letter and brochure were sent to you recently explaining the What We Eat in 
America Survey which is about what people eat and drink. (IF RESIDENT DOES NOT REMEMBER, HAND 
NEW COPY OF LETTER AND BROCHURE.) 


First, | would like to verify your address. Is this (READ ADDRESS FROM LABEL ABOVE)? [MAKE 
CORRECTIONS TO ADDRESS LABEL IF NECESSARY. IF AT CORRECT ADDRESS, CONTINUE WITH 
SCREENER. IF NOT AT CORRECT ADDRESS, THANK RESPONDENT AND LEAVE.] 


| need to determine if any members of your household are eligible to participate. To do this, I’d like to ask 
some questions about the persons who live here. Each eligible household that agrees to participate will 
receive a gift. Before we begin, | want to assure you that your answers will be combined with answers from 
other households to make totals and averages, in which no person or family will be identified. 


INTERVIEWER NAME: ——C—CCs™ Nd ee 
TIME STARTED 
INTERVIEWER ID: | |_| 


a aad (Wet || a ae 


DATE OF SCREENER: |_|__|-|__|__|-19|__|__| ~ TIMEENDED — 
MO  ~=—dDAY YR 


RESPONDENT’S FIRST NAME: 

DATE RECEIVED: 
VERIFIER ID: 

MC: 

BATCH #: 


LINE LETTER: |__| 


DISPOSITION CODE: 


Conducted for the United States Department of Agriculture by Westat Inc., Rockville, MD 


ASMA Mi TAS SW TAHW 


OW 23) SRUTIUT TS rae: 
: an re 
eyed 
“as Z ——: ADAGE 
! a ee = a ews Si ee = 
i 
) Vowmue @ gnitoubnes os ew baad (MAM SUIOY) ‘et of old i OrDUudoRTy 
Y eli fey ripley wth bev Lavy of Tvew Giew eiurioolid bn yetel A wankvonpA to wut 
( MAY Aa Min TOU S MvMagIgaA Y) Anhb bane we elqoeg wriw wWods a rlootw yorws By ity 
| (SAUHIORS GUA AS 130 YIOS 
. p ‘ee 
. i ‘vos (4) VOR SESRIGA GAIA) art e+ .eeerbbe wicy vitew of efi binow 7 
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. i of eeetpa iacly Siete ehdigie fan2 ole evil orw anomie ort! ods 2rcimeup 
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| ee lw yl oO eee Of thew nt gaps) OVE Ore EXE OHaN @ aiiaue’ 
| F 7 
= 
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a) 


2 
a” con 
2h 


ta 


VIMO Sa AOS SMor AGA 


— a ant eon | 


TIME STARTED a 

PM 
Including yourself, how many people live in this household? oat] 63a 
NUMBER 


What is the first name of the person or one of the persons who owns or rents this home? 
[ENTER NAME ON LINE A OF ENUMERATION TABLE BELOW.] 
[IF ONLY ONE PERSON LIVES IN HOUSEHOLD, GO TO Q6. OTHERWISE CONTINUE.] 


What is the first name of (REFERENCE PERSON)’s spouse, if any, who lives in this household? 
[ENTER NAME ON LINE B OF ENUMERATION TABLE BELOW.] 


ENUMERATION TABLE: AFTER LISTING HOUSEHOLD MEMBERS, RECORD NAME AND LINE LETTER OF 
SCREENER RESPONDENT ON FRONT COVER. ASK QUESTIONS 8 - 13 GOING ACROSS FOR EACH PERSON. 


ENUMERATION 
QUESTIONS 2-7: 


8. What is ! Which of the groups on this card 
(NAME)’s best describes (NAME)’s race? 
relationship to 
(REFERENCE 
PERSON)? 


REFERENCE 
PERSON 


And the other 


members of this 


household who are related to 


What are their first names? Let’s begin with the oldest. 
[ENTER NAME(S) IN AGE ORDER ON ENUMERATION TABLE BELOW.] 


Are there any other people living here who are not related to (REFERENCE PERSON)? 
[IF YES, ENTER NAME(S) ON ENUMERATION TABLE BELOW] 


(REFERENCE PERSON). 


[| have listed (READ ALL NAMES).] Is there anyone else living here now, such as friends, relatives, or roomers? 
[IF YES, ENTER NAME(S) ON ENUMERATION TABLE BELOW.] 


Have we missed other household members now away from home who _ usually live here, 
for example, someone away on vacation or business, or in a hospital? 
[IF YES, ENTER NAME(S) ON ENUMERATION TABLE BELOW.] 


MEXICAN 


PUERTO RICAN .. 


Do any of the groups 
on this card represent 
(NAME)’s national 
origin? 


OTHER SPANISH/ 
HISPANIC 


NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 


NONE OF ABOVE... 


OTHER SPANISH / 
HISPANIC 


NONE OF ABOVE... 


OTHER SPANISH / 
HISPANIC 


NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 
NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 
NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 
NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 
NONE OF ABOVE... 


OTHER SPANISH/ 
HISPANIC 
NONE OF ABOVE... 


12. AGE CHART (ASK 
IF NECESSARY: 
How old was 
(NAME) on 
(his/her) last 
birthday?) 

IF LESS THAN 1, 
RECORD AGE IN 
MONTHS. 


11. What is 
(NAME)’s date 
of birth? (ASK IF NOT 
OBVIOUS: Is 
(NAME) male 


or female?) 


(MM/DD/ 


cheddar 


eey ead Ya ae 
ts | 


De tas 


13. CODE SEX. 


SAMPLE 
PERSON 


THIS PAGE INTENTIONALLY BLANK 


PLACE BOX 1 LABEL HERE 


14. HAND SELECT CARD FOR NUMBER OF HOUSEHOLD MEMBERS. CARD SELECTED = S3-|__|__|. Hereisa 
card showing different sources from which households may receive income. Please think for a moment 
CARD ; : : ; : , 
$3 about the various sources from which the members of this household received income last year -- during 
1993. 


Thinking about all of the sources of income, please tell me whether the total income received by the 
members of this household during 1993 was more or less than the amount at the bottom of this card. 


pe reranteetehts heii ec Ieee NO 1 (BOX3) 

LESS ty cdontiay ae ee Oe 2 (BOX 2) -seennnennnnnnnenenn= BOX 2. 

REFUSED ceo ee 7 ee SAMPLE PERSON 

DONG NG Wits acinomae 8 SELECTION 

14a. ARE ileal AN CaN DREN bins THAN 6 YEARS OF AGE? CUECICEAERE 
NO rm 2 (BOX3) PERSON CQLUMD Ea 

EACH PERSON IN AGE 

14b. IS THERE A MALE 18 YEARS OF AGE OR OLDER? Pernietet 
VESIOVE. 8 1 (BOX3) 
NO‘ 10). 


PLACE BOX 3 LABEL HERE 


BOX 4. SAMPLE PERSON SELECTION 


CHECK SAMPLE PERSON COLUMN FOR EACH PERSON IN AGE AND SEX CATEGORY MARKED YES IN BOX 3. 
IS ANY PERSON IN THE HOUSEHOLD CHECKED AS AN SP? 


(CHECK SAMPLE PERSON COLUMN FOR EACH PERSON 
LESS THAN ONE YEAR OLD. THEN GO TO BOX 5) 


BOX 5. ASSIGNING SP NUMBERS 


ASSIGN SAMPLE PERSON NUMBER FOR EACH PERSON WITH A CHECK IN SAMPLE PERSON COLUMN. PLEASE 
NUMBER IN SEQUENTIAL ORDER. 


hey Would you give me your telephone number in case my office wants to check my work? 


TELEPHONE NUMBER: ( ) 


NO: TELEPHONE nee so ee 2 
BERPUSED Ritter nuh recmcn iene seers i 


BOX 6 
WAS ANY SAMPLE PERSON SELECTED? 


16. 
IY ESS ee MR ee ec ncntn es ccchnsessvcnscone Dt OMEEN 1¢(Q17) 
WAGE jet RoR SEE Aa Rae aime, Sac 2 (Q19) 
ve When are (you/he/she/they) planning to move? 
MONTH 
RECORD ANY AVAILABLE ADDRESS INFORMATION: 
18. Please give me the name and telephone number of two relatives or friends who would know where the 


members of your household could be reached in case we have trouble reaching you. Please give me the 
names of persons who are not currently living in the household. 


NAME #1: 


TELEPHONE NUMBER: ( ) | 


NAME #2: 


TELEPHONE NUMBER: ( ) 


DOES THE SCREENER LABEL REQUIRE THE MISSED DU PROCEDURE? 


| O if y) O "| 


COMPLETE MISSED DU PROCEDURE IF SP SELECTED, 
AND FORM NOW. THEN: CONTINUE WITH 


HH QUESTIONNAIRE. 
IF SP SELECTED, CONTINUE WITH HH 
QUESTIONNAIRE. IF NO SP SELECTED, 


TERMINATE. 
IF NO SP SELECTED, TERMINATE. 


TIME ENDED AM 
En = | 


MISSED DU PROCEDURE 


A MISSED DU IS A UNIT WITHIN OR ATTACHED TO THE STRUCTURE IN WHICH THE SAMPLED DU IS LOCATED, SUCH AS A 
BASEMENT OR ATTIC APARTMENT OR AN APARTMENT OVER AN ATTACHED GARAGE. IT MAY ALSO BE AN APARTMENT 
WITHIN A MULTI UNIT STRUCTURE. 


IF TWO OR MORE UNITS AT THIS ADDRESS (FOR EXAMPLE, AN APARTMENT BUILDING), 


SKIP TO STEP 2; OTHERWISE, BEGIN WITH STEP 1. 


1 AFTER COMPLETING SCREENER, SAY: We want to be sure that every household in this area has been given a 
chance to participate in this important survey. Are there any other 
living quarters at this address such as basement or attic apartments 
that we may have missed? 


2: CHECK IN THE LOBBY AND AROUND THE OUTSIDE OF THIS (HOUSE/BUILDING) FOR ADDITIONAL UNITS OR 
ENTRANCES TO THIS ADDRESS. 


3. RECORD DISCOVERED DUs ON FORM BELOW. NUMBER DISCOVERED DUs SEQUENTIALLY WITHIN SEGMENTS 
BEGINNING WITH DU NUMBER 501. EACH NUMBER MUST BE ASSIGNED ONLY ONCE WITHIN A SEGMENT. IF NO 
ADDITIONAL DUs, CHECK THE CIRCLE IN THE UPPER LEFT-HAND CORNER OF THE FORM. 


4. IF 1 TO 4 MISSED DUs ARE DISCOVERED, FILL OUT AN ASSIGNMENT BOX ON A BLANK SCREENER FOR EACH 
(INSTRUCTIONS FOR HOW TO DO THIS ARE IN THE INTERVIEWER MANUAL) AND CONDUCT SCREENER INTERVIEW. 
ADD THE DISCOVERED DUs TO A NEW LISTING SHEET AND TO ALL COPIES OF THE INTERVIEWER REPORTS. 


5. IF 5 OR MORE DUs ARE DISCOVERED, CALL SUPERVISOR FOR INSTRUCTIONS BEFORE YOU DO ANY ADDITIONAL 
SCREENER INTERVIEWS. ADD ALL OF THE DISCOVERED DUs TO A NEW LISTING SHEET AND THE SELECTED 
SAMPLE DUs TO ALL COPIES OF THE INTERVIEWER REPORTS. THEN FILL OUT AN ASSIGNMENT BOX ON A BLANK 
SCREENER FOR EACH SELECTED SAMPLE DU AND CONDUCT SCREENER INTERVIEW. 


MISSED DU FORM 


CHECK ( V) IF NO MISSED DU 


AT SAMPLED STRUCTURE: O PSU #2 o see eee Lew, SEG # 


DU # ASSIGNED ADDRESS OF DISCOVERED DU 


ian ves TOTAL ADDITIONAL DUs 


NEIGHBOR INFORMATION Led 


PLACE BOX 6 LABEL HERE 


20. ARE THERE ANY CHILDREN LESS THAN 6 YEARS OF AGE? 


BOX 7 
YES . RAPS terres 1 (Q21) 
NO Pe near rns ee. 2  (BOX8) RECORD AGE AND SEX IN 
SAMPLE PERSON CHART 
21. IS THERE A MALE 18 YEARS OF AGE OR OLDER? BELOW FOR EACH PERSON 


IN AGE AND SEX CATEGORY 
IN BOX 6. 


PLACE BOX 8 LABEL HERE 


BOX 9. SAMPLE PERSON SELECTION 
RECORD AGE AND SEX IN SAMPLE PERSON CHART BELOW FOR EACH PERSON IN AGE AND SEX CATEGORY IN BOX 8. 


SAMPLE PERSON CHART 
SAMPLE PERSON NUMBER 


BOX 10. ASSIGNING SP NUMBERS 


RECORD SAMPLE PERSON NUMBER FOR EACH PERSON RECORDED IN SAMPLE PERSON CHART ABOVE. PLEASE 
NUMBER IN SEQUENTIAL ORDER. 


RECORD NAME, ADDRESS, AND TELEPHONE NUMBER OF THE INDIVIDUALS PROVIDING THIS INFORMATION. 
if 
2. 
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OMB #: 0586-0014 
Expires: October 31, 1996 


WHAT WE EAT IN AMERICA: 1994-1996 


HOUSEHOLD QUESTIONNAIRE 


| PLACE CASE LABEL HERE 


a 


INTERVIEWER NAME: ——— ea 


TIME STARTEI 


(eee enc ee eee 
DATE OF INTERVIEW: |__|__|-|__|__|-19|__|_| TIME ENDED 
MO DA YR 


INTERVIEWER ID: |__| | 


RESPONDENT’S FIRST NAME: 


LINELETTER: |__| 


CHECK SCREENER. WAS FOR HOME OFFICE USE ONLY 
Q14 ANSWERED "MORE" OR 
DATE RECEIVED: 


VERIFIER ID: 
MC: 


[COPY ANSWER INTO 
BOX 5, PG. 13] BATCH #: 


Conducted for the United States Department of Agriculture 
by Westat Inc., Rockville, MD 
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TIME STARTED AM 
Saal mina en PM 


HOUSEHOLD QUESTIONNAIRE 


Let’s begin by talking about the general food shopping practice of this household. On the average, how 
often does someone do a major food shopping for this household? Would you say... 


More than once a WeeK, ............ccccseeeseceeeseeeeees 1 
Once a weelitt. 2008128 A Lee Poe 2 
Once every two WEEKS, ........cccccesscsseseereeseeeseens 3 
Once a month.of l6SS#Ofaate ee ee 4 
NGVOM? rons siecteressacesvese-ca.0. 0: ee eT oe ee: 5 (Q3) 


In what kind of store is this major food shopping usually done? Isit... 


ACSUDORINIAIK Cle nore oay aiaeeresstto tne tre 1 
AsmallistOres Ofis..-.esmnittt css. -ccsssteeme eters Pe 
somepiace else? SPECIFY) 2 ceseene eee 3 


During the last three months, how much money has this household spent per week or per_month at grocery 
stores, including the stores’ salad bars, soup bars, delis, etc.? Include purchases made with food stamps. 

Slee eels len OO PER WEEK a: 1 

PER MONTH ..... 2 


You said this household spent (AMOUNT IN Q3) per (week/month). About how much of this amount, if 
any, was for nonfood items, such as cleaning or paper products, food bought for feeding a pet, or 
cigarettes? (IF NONE, ENTER "0".) 


fee ie ee 0Oe PER WEEK oe re 1 
PER MONTH .... 2 


During the last three months, how much has this household spent per week or per month on food at 
specialty stores -- such as bakeries, liquor stores, delicatessens, meat markets, vegetable stands, health 
food stores, and other similar places -- when the food was brought into your home? (IF NONE, ENTER “O".) 
Sel ees | [i |-00" PER WEEK x7. 1 

PER MONTH .... 2 


ae 


During the last three months, how much has this household spent per week or per month at fast food or 
carryout places when the food was brought into yourhome? (IF NONE, ENTER "O0".) 

Sime 5! | 3)-00" PER WEEK... 1 

PER MONTH .... 2 


During the last three months, what has been this household’s usual amount of money spent per week or 
per month for food bought and eaten away from home? Include food and beverages that never entered 
your home, that is, eaten at restaurants, fast food places, cafeterias at work or at school or purchased from 
vending machines, for all household members. (IF NONE, ENTER "O".) 


taaly)e toot iuij00) /PERWEEKMS 1 
PER MONTH .... 2 


Now I have a few questions about the persons who live in this household. 
[IF ONE ADULT FEMALE, CONFIRM AND RECORD. 

IF MORE THAN ONE ADULT FEMALE, ASK:] 

Who is the female head of household? 


(IF NECESSARY, SAY: For the purposes of this survey, the female head of household is the woman who 
other household members think of as being in charge of household matters, that is, the woman of the 
house.) 


NAME: LINE LETTER: |__| (RECORD FIRST NAME 
AND LINE LETTER FROM 
NOP EMAL ES HAD Seat see teeta ter eet eee 2 SCREENER) 


[IF ONE ADULT MALE, CONFIRM AND RECORD. 
IF MORE THAN ONE ADULT MALE, ASk:] 
Who is the male head of household? 


NAME: LINE LETTER: |__| (RECORD FIRST NAME 
AND LINE LETTER FROM 
NCU NIAL EIA Do erage reece reer etre eee neces 2 SCREENER) 


THIS PAGE INTENTIONALLY BLANK 


RECORD FIRST NAME(S) AND LINE LETTER(S) OF ALL HOUSEHOLD MEMBERS 
WHO ARE 15 YEARS OF AGE OR OLDER STARTING WITH REFERENCE PERSON 
ON LINE LETTER A. THEN ASK Qs 10-16 IN SEQUENCE FOR EACH PERSON. 


CODER USE ONLY: 


ea | 
Sree LINE LETTER: |_A | LINE. LETTERS 


Looking at this card, NEVER ATTENDED SCHOOL NEVER ATTENDED SCHOOL 
what is the highest OR KINDERGARTEN ONLY: 00 OR KINDERGARTEN ONLY: 00 
grade or year of 
regular school (you ELEMENTARY: ELEMENTARY: 
have/NAME has) O1”"02™ 03°" 04""05""06" 07° 08 | 01 O02 O03 04 05 OGmO7meee 
ever completed? 
(CIRCLE CODE FOR HIGH SCHOOL: HIGH SCHOOL: 
HIGHEST GRADE 09 10 11 12 or GED 09 10 x 12 or GED 
OR YEAR.) 
COLEEGE OS 4 15 10. 717 COLLEGE?" "13°" 147 15° 1Gs5i7 


(1) (2) (8) (4) (+) (1) (2) (8) (4) (+) 


Last week, did (you/ NAME) 
work at all at a paid job or in 
(your/his/her) own business or 
farm? 


Do you have a paid job from 
which you were temporarily 
absent? 


How many hours did (you/he/ 

she) work at all jobs in the last 

week? Include all overtime ete | ee 
hours that (you/he/she) worked # OF HOURS 
and hours on any part-time jobs 

as well as (your/his/her) 


principal job. 


How many hours a week 
do/does (you/he/she) 
usually work? 


Which of the 

categories on this 

card comes closest 

to describing the 01 02 03 04 05 06 07 08 01 02 038 04 05 06 O07 08 
paid work [you do/ (NP or Q17) (NP or Q17) 

(he/she) does]. 


Which of the reasons LOOKING FOR WORK LOOKING FOR WORK 
on this card best GOING TO SCHOOL GOING TO SCHOOL 
describes why (you KEEPING HOUSE KEEPING HOUSE 
were/NAME was) not | RETIRED RETIRED 

working at a paid job 

last week? (CIRCLE 

ONLY ONE) 


LINE LETTER: | __ 


NEVER ATTENDED SCHOOL 
OR KINDERGARTEN ONLY: 00 


ELEMENTARY: 
Or 0203 04 05 06 07 08 


HIGH SCHOOL: 


09 10 11 12 or GED 


COLLEGE: 13 14 15 16 
(1) (2) (8) (4) 


17+ 
(5 +) 


# OF HOURS 


# OF HOURS 


01,02, 03.°04"05 06 07 08 
(NP or Q17) 


LOOKING FOR WORK 
GOING TO SCHOOL 
KEEPING HOUSE 
RETIRED 

UNABLE TO WORK 
OTHER (SPECIFY) 


LINE LETTER: |__ 


NEVER ATTENDED SCHOOL 
OR KINDERGARTEN ONLY: 00 


ELEMENTARY: 
Olss02" 703 ~ 04 05. 06 O7 08 


HIGH SCHOOL: 


09 10 14 12 or GED 


COLLEGES "13 14°65 46 
(1) (2) (3) 


17+ 
(4) (5+) 


peat peal pe 
# OF HOURS 


# OF HOURS 


01 02 03 04 05 06 O07 08 
(NP or Q17) 


LOOKING FOR WORK 
GOING TO SCHOOL 
KEEPING HOUSE 
RETIRED 

UNABLE TO WORK 
OTHER (SPECIFY) 


LINE CETCER:s |e 


NEVER ATTENDED SCHOOL 
OR KINDERGARTEN ONLY: 00 


ELEMENTARY: 
01 02° 03> 04° G5 0607 08 


HIGH SCHOOL: 


09 10 11 12 or GED 


COLLEGE: 13 14 15 16 
(1) (2) (8) (4) 


17+ 
(5+) 


pelea] 


# OF HOURS 


eco a ha 
# OF HOURS 


01 02 03 04 05 O06 07 08 
(NP or Q17) 


LOOKING FOR WORK 
GOING TO SCHOOL 
KEEPING HOUSE 
RETIRED 

UNABLE TO WORK 
OTHER (SPECIFY) 


We 


18. 


In regard to this dwelling, is the property . . . 


HAND 
CARD 
H4 


Owned or being bought by 


someone living in this household, ............... 1 
Rented with payment required, Of ...............0 Z 
Occupied without payment of rent 

OCICS eau te ode cea va ears 3 


Looking at this card, what is the main source of the water used for cooking in your home? Isit... 


the community water SUPPIY, | ....000.-.0ss0s-ces+00-0e 1 
your own Well OF Fain CISEMN, .....-.-a.c<<-s-00sse<nenn0 2 
your own spring or a public spring, ..............- 3 
bottled water you purchase, OF ............ecseeeeeee 4 
something else2e(SPEGIEV Gree eusies 5 


What is the main source of the water used in your home for preparing beverages such as coffee, 
tea, juices, and baby formula? (Is it... 


the community Water SUDDIY, } ...2..:52.0:0:--0cen-seon 1 
your Own well or rain CISteMN, ............:ceeeereeeeees re 
your own spring or a public spring, ................ 3 
bottled water you purchase, OF ............ccccesseees 4 
someting else?) (SPECIFY)... .ccccssccccaccecseses =) 


What is the main source of plain drinking water in your home? (Is it... 


the community water Supply, ...........:.:csceeeeeeee 1 
your Own well or rain CIStEMN, ..........:0:ceseeeseeeee 2 
your own spring or a public spring, ................ 3 
bottled water you purchase, OF ...........:csceeeeee 4 
SOMO nNOreise 2 ai OPE GIy \ariecicarcassd-renct ee 5 


21. Returning to the topic of food, who usually plans the meals? (RECORD FIRST NAME AND LINE LETTER 
FROM SCREENER. IF NOT A HOUSEHOLD MEMBER, ENTER "Y" AS THE LINE LETTER.) 


IF ALL HOUSEHOLD MEMBERS, ENTER “Z" HERE: |__| AND GO TO NEXT QUESTION. 


NAME: 
AN Ger Ect lice pee) 
NAME: 
UNE LERTER: | | 
NAME: 
UNELERTERS |) | 
ee: Who usually does the major food shopping? (RECORD FIRST NAME AND LINE LETTER FROM 
SCREENER. IF NOT AHOUSEHOLD MEMBER, ENTER “Y" AS THE LINE LETTER.) 


IF ALL HOUSEHOLD MEMBERS, ENTER "Z" HERE: |__| AND GO TO NEXT QUESTION. 


NAME: 
UINE TETVER: || 
NAME: 
DINE. LETTER: =| eee 
NAME: 
DINE CERT ERS eee 
23. And who usually prepares the food? (RECORD FIRST NAME AND LINE LETTER FROM SCREENER. IF 
NOT A HOUSEHOLD MEMBER, ENTER "Y" AS THE LINE LETTER.) 


IF ALL HOUSEHOLD MEMBERS, ENTER "Z" HERE: |__| AND GO TO NEXT QUESTION. 


NAME: 
LINELETTER: |__| 
NAME: 
PING LEDER |aes| 
NAME: 


LINELETTER: |__| 


24. Is anyone in this household on any kind of diet either to lose weight or for some other health-related 


reason? 
ES oa sscesensaseaz tan nseapaa ene ale seiaie em aeaaie Oe: 1 
IN) ess sccse seco conga ce fidaneobanssnvtee yan gouasesanvariweatenmerlstes 2 (BOX 1) 
25: HAND Which of these diets on this card (are/is) (you/he/she/they) on? (CIRCLE ALL THAT APPLY) 

se WEIGHT LOSS OR LOW CALORIE DIET ....... 01 
LOW FAT.OR CHOLESTEROL DIET ......:.-...... 02 
LOW SALT OR SODIUM DIET 2 oor i catccice- rane. 03 
SUGAR FREE OR LOW SUGAR DIET ............ 04 
LOW FIBER DUE Weer sce re recertryieen 05 
IGT UB pees corres rescence cece acececcoreer ee 06 
DIABETIC QE De teres cspcectress cote sctanye sane orcarseanvares 07 
OTHER DIET (PLEASE DESCRIBE) ............... 08 


BOX 1 


CHECK SCREENER. ARE THERE ANY FEMALES IN THE HOUSEHOLD 10 THROUGH 55 YEARS 
OF AGE? 


26. Is anyone in this household now pregnant? 
IY SS Se ream 2 hes etc e taes Secce acces ct nce cvnncn vest 1 
IN Oyen hepa cater as oper crs ogerecmescnnareosreancaravanuctiey 2 (BOX 2) 
27: Please tell me who. (RECORD FIRST 28. How many months pregnant (are you/is 
NAME AND LINE LETTER FROM NAME)? 
SCREENER.) 
NAME: Leet ele exe | 
MONTHS PREGNANT 
LINE LETT EMSs) = LESS THAN ONE MONTH ................... 00 
oa fae 
NAME: MONTHS PREGNANT 
LESS THAN ONE MONTH .........0...... 00 
LINE LETTER? || 


BOX 2 


CHECK SCREENER. ARE THERE ANY CHILDREN IN THE HOUSEHOLD 3 YEARS OLD OR LESS? 


eo. 


30. 


32. 


Are any children currently being breast fed? 


SY ES ae ear 
Wipe ee aaa 
Please tell me who. (RECORD FIRST chil 
NAME AND LINE LETTER FROM 
SCREENER.) 
NAME: 


LINE-LE ETERS: | |_| 


NAME: 


LINE LETTER: |__| 


Please tell me the name of the woman who 

is breast feeding (CHILD). (RECORD FIRST 
NAME AND LINE LETTER FROM SCREENER 
FOR EACH CHILD.)? 

NAME: 


LINE LETTER: |__| 


NAME: 


LINE LETTER: |__| 


Is anyone in this household receiving benefits under the WIC Program at the present time? (That is the 


Women, Infants and Children Program.) 


VY ES@ eee 

NO ee 

DON’T KNOW 
Please tell me who in this household is 34. 


receiving WIC benefits. (RECORD FIRST 
NAME AND LINE LETTER FROM 
SCREENER.) 
NAME: 

LINE LETTER: 
NAME: 

LINE LETTER: 
NAME: 

LINE LETTER: | 
NAME: 

LINE LETTER: | 


NAME: 


LINE LETTER: 


How long (have you/has NAME) been 
receiving WIC benefits? 


(sl aes A MONTHS 2 cee 1 
YEARS eee 2 
(eee eee ONT S ore 1 
YEARS cede cas 2 
Ref MMONTHS ee 1 
VEARS fee 2 
Pe eee AMONT HS teen 1 
VERRC 2 
ee MONTHS 1 
VERS ee 2 


BOX 3 


CHECK SCREENER. ARE THERE ANY CHILDREN IN THE HOUSEHOLD AGE 
5 THROUGH 18 YEARS? (REMEMBER TO INCLUDE 18 YEAR OLDS) 


1 [RECORD FIRST NAME AND LINE LETTER IN GRID BELOW. 
THEN ASK Qs 35-41 IN SEQUENCE FOR EACH CHILD.] 
2 (BOX 4) 


CODER USE ONLY: NAME: NAME: NAME: 


Newco peat 
aes LINE FETTER: ses DNECE Weng ae LINE LETTER: | ae 


Now | would like to ask about school breakfast and lunch programs. 


Does (NAME) attend a 
kindergarten, grade school, 
junior or high school? 


Does (NAME) attend a 
school which serves school 
lunches? These are 
complete lunches costing a 


fixed price every day. 


During the school year, 
approximately how many 
times a week does (he/she) 
usually get a complete 
school lunch? 


Does (he/she) get these 
lunches free, at a reduced REDUCED PRICE REDUCED PRICE REDUCED PRICE 


price or does (he/she) pay FULL PRICE FULL PRICE FULL PRICE 
full price? DON’T KNOW DON’T KNOW 


Does (NAME) attend a 
school which serves a 
complete breakfast costing a 


fixed price every day? 


During the school year, 
approximately how many 
times a week does (NAME) 
usually get a complete 
breakfast at school? 


Does (he/she) get these 
breakfasts free, at a reduced 
price or does (he/she) pay 
full price? 


10 


NAME: NAME: NAME: NAME: 
LINE LETTER: | _ LINE LETTER: | _ LINE LETTER: | ___ LINE LETTER: |__ 


REDUCED PRICE REDUCED PRICE REDUCED PRICE 
FULL PRICE FULL PRICE FULL PRICE 
DON’T KNOW DON’T KNOW 


FULL PRICE FULL PRICE FULL PRICE 
DON’T KNOW DON’T KNOW DON’T KNOW 
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BOX 4 


CHECK SCREENER. ARE THERE ANY CHILDREN IN THE HOUSEHOLD AGE 1 THROUGH 5 YEARS? 


1 [RECORD FIRST NAME AND LINE LETTER BELOW. 
THEN ASK Q42.] 
2 (Q43) 


NAME: NAME: NAME: NAME: 


CODER USE ONLY: 


a aed 


LINE LETTER: LINE LETTER: LINE LETTER: LINE LETTER: 


Does (NAME) attend a child 
care program which gives 
(him/her) any meals or 
snacks? 


43. Which of these statements best describes the food eaten in your household in the last 3 months-enough of 
the kinds of food we want to eat; enough but not always the kinds of food we want to eat; sometimes not 
enough to eat; or often not enough to eat? 


ENOUGH OF THE KINDS OF FOOD WE WANT TO EAT ..........::cesceeceeesees 1 (BOX5) 
ENOUGH BUT NOT ALWAYS THE KINDS OF FOOD WE 
WAIN [eA GS AT sacs vgnates txniaxth reiaa ie lcted ans vi iN caked s spies envexaris Dibasrizéconglavstoiears 2 (BOX5) 
SOME IMs NOT ENOUGH 10 A ies rcectantatitcsnssrsscrns tarnteecsscaastectcanasl 3 
Fe ESIGN Me Nig Rest hal bd CRETE RAN ak Weipa meen civ unbebaisaaiean' Oey cours aes tr av 4 
44. In which of the last three months did your household not have enough to eat? (CIRCLE ALL THAT APPLY.) 
LPS 1 IIGOIN EM cenperatinsnad parasaransednssacsisscseniseteureay 1 
+HE MONTH BEFORELAS Ptiiccnccmtrans 2 
TWO MONTHS BEFORE LAST ............0ceeees 3 
45. Which of the following reasons explain why your household did not have enough food: 
a. Did not have enough money, food stamps, or WIC vouchers to buy food or beverages. 
VES svsncovancepassdelaipinecnntnsenbivedsstsesissvoncens cette 1 
NED DeN in th sibtininevireneedsstideirti cahbrrenscthacete 2 
b Did not have working appliances for storing or preparing foods (such as stove or refrigerator). 
DY FES Aisekenssnnches Meer lesetel Sorte testes teisPsrekvsuecesvancaktc seme 1 
NAD -seairlatnideee Hat etateottrea et tre ieeterks ans cecunstisncnetes 2 
o Did not have transportation or had transportation problems. 
VEG a iecett a esto rdvecteres intra sreewdentecd Rbxtiasi cirrus vesaove 1 
ORS Se Re ARR, SRL HOR are 2 
d, Some other reason? 
YES (EXPIAIN) 4 trapetiee Lith ss dasckpssinancthongandth 1 
bot 
NU cincssrsinrierateevehaulys ancammeertesaenty eat eerinrad 2 
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46. 


47. 


49. 


50. 


51. 


Last month, how many days did your household not have food, or money or food stamps to buy food? 


ers 
NUMBER OF DAYS 


BOX 5 


CHECK COVER. WAS SCREENER 014 ANSWERED "MORE" OR "LESS"? 


SELECT CARD FOR NUMBER OF HOUSEHOLD MEMBERS. CARD SELECTED = S3-|__ |_|. 


HAND . : , : Pdi 7 
Here is a card showing different sources from which households may receive income. Please think 
CARD , : - 
$3 for a moment about the various sources from which the members of this household received 


income last year ~ during 1993. 
Thinking about all of the sources of income, please tell me whether the total income received by 


the members of this household during 1993 was more or less than the amount at the bottom of 
this card. 


What was the total net income after business expenses received in 1993 by all members of this household 
who have their own business or farm? 


TOTAL NET INCOME $|_|_|__|,|__|__| 


|.00 


Did any member of this household receive any income from interest, dividends, or annuities in 19937 


What was the total arnount of income from interest, dividends, and annuities received in 1993 by all 
members of this household? 


13 


es During 1993, approximately how much income from all sources did you and other household members 
have before income taxes? (Please give me your best estimate.) 


TOTAL INCOME $|__|__|__|,/__|__|__].00 (Q54) 
NOT A HOUSEHOLD UNIT IN 1998 ........... 999996 (Q54) 
REFUSED -sscsesssscconeannecescenemtteaeetrcrninrirane 999997 (Q53) 
DONATIGNOW (.7ccscsssasegnesssasnpsensvarosnsonscesneys 999998 (Q53) 
53. HAND Please tell me which letter on this card best represents your combined household income before 
CARD taxes for 1993. 
4c LETTER+|—-| 
54. Now, consider cash, savings or checking accounts, stocks, bonds, mutual funds and certificates of 
deposits. Do the members of this household have more than $5,000 of such savings or cash assets at this 
time? 
ba ee rn er ees a 1 (Q56) 
IN eer eccccesena saith Wass pana spas ccna soa eiasa Te eee eee 2 
55. HAND What letter on this card best represents the total savings or cash assets of all household members 
eon 
CARD at this time’ 
ald LETTER es 
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57. What was the total income 
received last month by all 
members of your household -- 
before taxes and other 

deductions -- from (SOURCE)? 


Here is a card that lists 
a number of income 
HAND |} sources I’m going to ask 
CARD about. Please tell me 
H8 whether any member of 
this household received 
income last month from 
(SOURCE). 


Wages or salary from a job 
including tips or commissions? 


Any Social Security or 
Supplemental Security income? 


Income from pension or 
retirement? 


Unemployment or Workmen's 
Compensation? 


AFDC, general assistance or other 
public assistance program? (Do not 
include food stamps or WIC benefits) 


Other sources, such as alimony, 
child support, and other regular 
monthly contributions from persons 
not living in this household? 


BOX 6 


CHECK Q56 AND Q57. IS THERE ANY RESPONSE OF DON’T KNOW OR REFUSED? 


58. Would you please tell me whether the total income received by the members of this household 
during (LAST MONTH) was more or less than the amount on this card next to the number 


wit (NUMBER OF MEMBERS IN THE HOUSEHOLD). 
YC] 2 Sete ae a gee ee ie teaeante oh Re eREeP rere 1 
Ee Sree erence cates taken cetecerich snseatsncekiosucbeattees 2 
59. Did any member of your household receive food stamps in any of the last 12 months? [IF RESPONDENT 


IS UNCERTAIN, SAY: That is, from (NAME OF CURRENT MONTH) 1993 through (NAME_OF LAST 
MONTH), 1994]. 


SAE oe ee roe ee en tee 1 
NO) raey enn arnome tr rae ye Bette crn 2 
DON E. KNOW (:255:.the-cccssseor ocmmiceveutncratescererans 8 
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60. Is anyone in your household authorized to receive food stamps at the present time? (An authorized person 
is one whose name appears on a certification card.) 
SESE bead RN Lyn Sk A pene a eee Re rrr as 1 
NO? BaP Fc cens acta sha aes L detach edevodaadanccatondtes 2 (END) 
St. Is everyone in your household covered under this food stamp allotment? 
VES Sie SA res cence eet crate Meas pe raeeomen rece 1 (Q64) 
a is ea lly Se Rpt hegre rece ay nto Beh 2 
62. Which persons are covered? 
NAME: NAME: 
UNE LERTER |e =| UNE CE neh | eel 
NAME: NAME: 
LINE-LETIERS | CINE LELTER: 2 ae) 
NAME: NAME: 
LINE LETTER: |__| LINELETTER: |__| 
63. Think now just about these people, that is (READ NAMES IN Q62) and their income from the 
HAND 5 : . : 
CARD sources on this card. Approximately how much income from all sources did they have before 
HE taxes in (NAME OF LAST MONTH)? (Please give me your best estimate for just these people 
receiving food stamps.) 
pale pace Sl ary peel al 0 
64. On about what date did your household last get food stamps? 
[eee Sie es |S eee ee 
MONTH DAY YEAR 
HAVE NOT RECEIVED THEM YET ............ 969696 (END) 
DON @KNOW taaaecics wrote coer eer 989898 
65. What was the total amount of stamps you received at that time? (Please give your best estimate.) 


S| zacisie bret s|yijaae) [oterseue]"00 


DON UEGKINOW oro errr pre 999998 


TIME ENDED AM 
SF aren (PM 
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DAY ONE INTAKE QUESTIONNAIRE 


PLACE CASE LABEL HERE 


SAMPLE PERSON #: |___|_—i| 


INTERVIEWER NAME: 


INTERVIEWER IDi\] te] is. | 


DATE OF INTERVIEW: |__| |-|__|__|-19|__|_| 
MO DA YR 


DAY OF INTERVIEW: INTERVIEW CONDUCTED: 


IN PERSON 
BY TELEPHONE 


FIRST NAME OF 


SAMPLE PERSON: FOR HOME OFFICE USE ONLY 
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MC: 
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TIME STARTED AM 
eT ON 


I'd like you to tell me everything (you/NAME) had to eat and drink all day yesterday, 
HAND Sina pan : 
CARD (DAY), from midnight to midnight. Include everything (you/NAME) ate and drank at 
i home and away -- even snacks, coffee, and alcoholic beverages. [DO NOT 
INTERRUPT RESPONDENT. USE HANDCARD I1 IF NECESSARY.] 


[IF INFANT OR CHILD SP:] I'd like you to tell me everything (NAME) had to eat and drink all day 
yesterday, (DAY), from midnight to midnight. Include everything (he/she) ate and drank at home 
and away, including snacks and drinks (and bottles or breast milk). 


[WHEN RESPONDENT STOPS, ASK: Anything else?] 


Now I’m going to ask you specific questions about the foods and beverages we just listed. When 
you remember anything else you ate or drank as we go along, please tell me. 


About what time did (you/NAME) begin to (eat/drink) the (FOOD)? [OR CONFIRM IF 
RECORDED ON QUICK LIST] 


Looking at this card, please tell me what (you/NAME) would call this occasion? [OR CONFIRM 
IF RECORDED ON QUICK LIST] 


HAND 01 BREAKFAST 
CARD 02 BRUNCH 
12 03 LUNCH 
04 DINNER 
05 SUPPER 
06 FOOD AND/OR BEVERAGE BREAK 
SNACK 
ALCOHOLIC BEVERAGE 
OTHER BEVERAGE 
07 FEEDING (INFANT ONLY) 
08 OTHER (SPECIFY) 


BOX 1 


TRANSFER QUICK LIST FOOD TO GRID. CHECK OFF FOOD IN QUICK 
LIST AS IT IS TRANSFERRED. 


SEE FIB COLUMN Q4 FOR FOOD PROBES. 


[SEE FIB COLUMN Q5 FOR AMOUNT SPECIFICATIONS.] How much of this (FOOD) did 
(you/NAME) actually (eat/drink)? 


[ASK IF NOT OBVIOUS:] Did (you/NAME) have (NEXT QUICK LIST ITEM) with your 
(OCCASION) at (TIME) or was that at another time? 
[IF SAME OCCASION, GO BACK TO BOX 1. IF ANOTHER TIME, GO BACK TO Q2.] 


INDIVIDUAL INTAKE FORM 


a. Q4 


— QuickListof = ‘ (HAND- Food/Drink Description of Food/Drink 
Food items = [V CARD I2) and Additions and Ingredient Amount 


Q5 ; Q7 Q8 
How much of this Where Eaten At 
(FOOD) did you Obtained Home 
actually (eat/drink)? (HAND CARD I3) 


INDIVIDUAL INTAKE FORM (continued) 


Q4 
Food/Drink Description of Food/Drink 
and Additions and Ingredient Amount 


N 


fee) 


et) 


> 


Ss 


N 


N 


(d) 
— 


ls 
ad : 


o ice) 


Q5 
How much of this 
(FOOD) did you 
actually (eat/drink)? 


Q7 
Where 
Obtained 
(HAND CARD I3) 


Q8 
Eaten At 
Home 


Q9 
Ever At 
Home 


INDIVIDUAL INTAKE FORM (continued) 


Q3 Q4 


Occ. 
(HAND- Food/Drink Description of Food/Drink 


CARD I2) and Additions and Ingredient Amount 


Q5 Q7 Qs 
How much of this Where Eaten At 
(FOOD) did you Obtained Home 
actually (eat/drink)? (HAND CARD I3) 


REVIEW: Now let’s see if | have everything. I'd like you to try to remember anything else (you/NAME) 
ate or drank yesterday, that you haven't already told me about, including anything 
(you/he/she) ate or drank while preparing a meal or while waiting to eat. 


a. At (EARLIEST TIME) (you/NAME) had (FOODS) for (EARLIEST OCCASION). . . 
Did (you/he/she) have anything to eat or drink before that, starting at midnight? 


b. Next, at (TIME) (you/he/she) had (FOODS) for (QCCASION). . . 
Did (you/he/she) have anything to eat or drink between (LAST OCCASION) at (LAST TIME) and 


(THIS OCCASION) at (THIS TIME)? 
[REPEAT b FOR EACH OCCASION] 


Cc. Did (you/he/she) have anything to eat or drink yesterday after (LAST TIME) but before midnight? 


Now let’s go back to the beginning of the day and find out where (you/NAME), or other people who live 
here, obtained the food (you/he/she) ate and where (you/he/she) ate it. 


7. (Looking at this card) Where did (you/he/she) obtain this (FOOD/MOST OF THE INGREDIENTS 


FOR THIS FOOD)? 


HAND 01 STORE, SUCH AS 09 SOUP KITCHEN, SHELTER, FOOD PANTRY 
CARD SUPERMARKET, GROCERY STORE, 10 MEALS ON WHEELS 
3 OR WAREHOUSE, CONVENIENCE 11. OTHER COMMUNITY FOOD PROGRAM 
STORE, DRUG STORE, OR 12 GROWN OR CAUGHT BY YOU OR SOMEONE 
GAS STATION YOU KNOW 
SPECIALTY STORE SUCH AS BAKERY, 
DELI, SEAFOOD, ETHNIC FOOD, IF FISH OR SEAFOOD, ASK: Did it come from a... 
HEALTH FOOD 71 Freshwater lake, pond, or river 
COMMISSARY 72 The ocean, or 
PRODUCE STAND OR FARMER’S 73 A bay, sound, or estuary? 
MARKET 74 DON’T KNOW BODY OF WATER 
02 RESTAURANT WITH WAITER/WAITRESS 
SERVICE 13 SOMEONE ELSE/GIFT 
03 FAST FOOD PLACE, PIZZA PLACE 
04 BAR, TAVERN, LOUNGE SOME OTHER PLACE (PLEASE DESCRIBE) 
05 SCHOOL CAFETERIA 14 MAIL ORDER PURCHASE 
06 OTHER CAFETERIA 15 COMMON COFFEE POT OR 
07 VENDING MACHINE SNACK TRAY 
08 CHILD CARE CENTER, FAMILY DAY 16 RESIDENTIAL DINING FACILITY 
CARE HOME, ADULT DAY CARE 17 OTHER (SPECIFY) 
98 DON’T KNOW 
8. Did (you/NAME) (eat/drink) this (FOOD) at your home? 
IF YES, GO BACK TO Q7 FOR NEXT FOOD. 
IF NO, GO TO Q¢g. 
9. Before (you/NAME) (ate/drank) this particular (FOOD), was it ever at your home? 


REPEAT Q7-9 FOR EACH FOOD. 


10. 


Ps 


1 


© 


14. 


Was the amount of food that (you/NAME) ate yesterday about usual, less than usual, or more 


than usual? 


USUAL ee cen eeene Wee cena 1 (Q13) 
LESS THAN USUAL ....-ccccssesccsseeccssseeseseees 2 (Q11) 
MORE THAN USUAL .....-csssccsssecccsseeeesssees 3 (Q12) 
SICKNESSiit acd eee es 01 
SHORT OF MONEY .....cccsccccssecccssseccesseess 02 
TRAVELING havo eer eee 03 
AT A SOCIAL OCCASION OR 

ON A SPECIAL DAY o.cceccccsssceccssssececesese 04 
ON VACATION 4 cee coe nee 05 
TOC BUSY eee been eee 06 $ (Q13) 
NODRURGR Yen oe eee 07 
DIE TINGE rend ccce rr oe 08 
EASTING Heer cee eh oe eae 09 
BORED OR STRESSED .......--sssssscssseesseee 10 
SOME OTHER REASON (SPECIFY) ....... 11 


What is the main reason the amount (you/NAME) ate yesterday was more than usual? 


TRAVELING ot eee eke eee tea Pe 1 

AT A SOCIAL OCCASION OR 
ONINSPECIAU DAY pannerane.. 2 

ONTACATION ee 3 

VERV HUNGRY 2 ee 4 

BORED OR STRESSED .......scscssessssssesees 5 

SOME OTHER REASON ..........s.s-es0seseeee-+ 6 
(SPECIFY) 


ORDINARY SALT/SEA SALT .u....sssse.0.-- 1 
SEASONED SALT OR OTHER 

FLAVORED SALT ....sssssssssssssssessesssssseeees 2 
(ITE SALTO on edt ee 3 
SALRSUBSIIUIER 6 ee 4 
NONE RS ee ora on 5 (Q15) 
DON TEKNOW se <0 ee eye oe 8 (Q15) 


What type of salt, if any, (do you/does NAME) add to (your/his/her) food at the 
table? Would you say it is ordinary salt, seasoned salt, lite salt, or a salt substitute? 


How often (do you/does NAME) add (ANSWER IN Q13) to (your/his/her) food at the table? Is it 


always, frequently, sometimes, or rarely? 


ALWAY Sic 2 etre vin oer es ceoaae ce 1 
PREGQUEN FEY esters cetera eran areas 2 
SOME PIMES re sererectestsectss percents 3 
RARE LV rests oescer tees eget core eter eesavene 4 


HAND Now I'd like you to think about all of the plain drinking water that (you/NAME) had 


15. 


16. 


We 


18. 


yesterday, regardless of where (you/he/she) drank it. By plain drinking water, | mean tap 
water or any bottled water that is not carbonated, with nothing added to it, not even lemon. 


How many ounces of plain drinking water did (you/he/she) drink yesterday? 


jie (GNA 
OUNCES 
NONE ste tae eine WO on ete 000 (Q18) 


How much of this plain drinking water came from your home? Would you say all, most, some, or 
none? 


IN We scaly, Aa tae linterna. tet 1 (Q18) 
RIS ees eee eee 2 
SOME crencue ditetnscireasi rs snacuen ieee dee 3 
NO) | Sotsa-q thas malian Meatless <<” Ohatee 4 


What was the main source of plain drinking water that did not come from your home? Was it tap 
water, water from a drinking fountain, bottled water, or something else? 


TAP WATER AND/OR DRINKING FOUNTAIN .........e:cccscesseeeeeeeeeeees 1 
BOTITED. WATE Reta oi eess tee ee Pe oer eet 2 
OTHER SOUR Circa e rere merece tres ars 0 ame nein 6 shee el a inans aeie 3 
(SPECIFY) Lae 
DONTRKNOW terete cee serie Oia ote eel 8, 8 oo 


(Are you/Is NAME) on any kind of diet either to lose weight or for some other health-related 
reason? 


NO sess cok keeled ee Tae eee ee ea 2 (Q22) 


THIS PAGE INTENTIONALLY BLANK 


CIRCLE ALL THAT APPLY AND ASK Q20 AND | 
Q21 IN SEQUENCE FOR EACH DIET 
CIRCLED. 


WEIGHT LOSS LOW FAT OR 
OR LOW CHOLESTEROL LOW SALT OR 
CALORIE DIET DIET SODIUM DIET 


Looking at this card, 
please tell me which of 
these diets (you 
are/NAME is) on. 


03 


20. (Are you/Is NAME) on this (ANSWER 
IN Q19) because... 
A doctor or dietitian suggested 
or prescribed it? 00.0... 


A medical condition 
runs in your family? ................... 


You joined another 
person on his/her diet? .............. 


You want to maintain or 
improve your health? .................. 


You want to lose weight? ............... 


Some other reason? ................00000.- 
(IF YES, SPECIFY) 
ie aa ica won |. 


Looking at this card, 
please tell me which of 
these best describes the 
source of (your/his/her) 
(ANSWER IN Q19). 
(CODE ONLY ONE) 


AN ORGANIZED WEIGHT 
LOSS PROGRAM 


SOMETHING YOU READ OR 
HEARD ABOUT 


SOMETHING YOU MADE UP 


SOMETHING ELSE 
(SPECIFY UNDER CODE 5) 


| Cigany Casein (Sie 


11 


SUGAR FREE OTHER DIET 
OR LOW SUGAR LOW HIGH | DIABETIC 
DIET FIBER DIET FIBER DIET | DIET ——6PECIFY) 


07 


(Goel GFECIFY) (SPECIFY) (SPECIE) SFEGY) 


eae Sor sede (SPEC) earaak? patente 


12 


22) 


23. 


24. 


20: 


Do you consider (yourself/NAME) to be a vegetarian? 


How often, if at all, (do you/does NAME) take any vitamin or mineral supplement in pill or liquid 
form? Would you say every day or almost every day, every so often, or not at all? 


HAND 
CARD 
19 


EVERY DAY OR ALMOST 

EVERY DAYS Oe 1 
EVERY SO OFTEN o.cecccecscsseeccsseseceseeeessees 2 
NOTATALY eee, en Mee Cre | 3 (Q26) 


MULTIVITAMIN (ice econ seoncurt eecertaees ccd 1 
MULTIVITAMIN WITH IRON 
OR OTHER MINERALS ................ eee 2 


ANID OTRO Cire creer al eeetcreccace en rc 3 


BOX 2 


IS "4" CIRCLED IN Q24? 


1 (Q25) 


VITAMIN Avcccccs eect ceteris en 01 
VITAMIN B/B COMPLEX ...............:c0000 02 
VITAMIN G coirsrecee Miocene com eectenes een neues 03 
VITAMIN Die cca ees 04 
VITAMIN eee ec eee eres 05 
CACGIOM es. ce eee eee 06 
OLA CIN ere he ee eee ees 07 
FLUORIDE Ve etree eee 08 
TRON tient ct ees ccy aee Sereey 09 
Fd | \\ Sentipmentene siti. | ei ere te cna 10 
SELENIUM scant + coterie eerie 14 
CHROMIUMAL....c.th..-.aceeee rereeneen crate 12 
SOMETHING ELSE (SPECIFY) ............... 13 


13 


Looking at this card, which of these types of supplements (do you/does NAME) 
usually take... a multivitamin; multivitamin with iron or other minerals; combination 
of Vitamin C and iron; or single vitamins or minerals? (CIRCLE ALL THAT APPLY) 


Looking at this card, which of these single vitamins and minerals (do you/does 
he/she) usually take? (CIRCLE ALL THAT APPLY) 


(Do you/Does NAME) take a fish oil supplement? 


NER RERE fr, SOOM ney SER eR 1 

NOM eee As cn ata ne eae 2 
(Have you/Has NAME) ever had (your/his/her) blood cholesterol checked? 

(SLSR 2 14. fon = 8d St UR OE 1 

NO lee tae 22 >... ed a rn 2 

DOR UTRISN GUY Gites hi on csatcenscsesecsesessseesses 8 


How tall (are you/is he/she) without shoes? 


ve hiealjod 
FEET INCHES 


About how much (do you/does NAME) weigh without shoes? 
eae ies) 


~ POUNDS — 


In general, would you say (your/his/her) health is excellent, very good, good, fair, or poor? 


EXC EDEN late erence teens 1 
WARN 46,0] Wik on risk emaeraeponammetinn ee aha ieraieas 2 
POO Dre eee a ite 3 
lal al esccrecy rnin tai es a See a een 4 
A] O] gee ae Brean kk reer eee oe 5 


14 


32. (Do you/Does NAME) have any food allergies that make it necessary to avoid certain foods? 


33. What food allergies (do you/does NAME) have? (CIRCLE ALL THAT APPLY.) 


WHEA Taco ey eine ee es tke 01 
COW:S, MIEKA OeMOR ALMOST 02 
EGGS PV GAs vscditnasiaach 03 
FISH OR SHELLFISH .....ssesesesssssssesssssssssen 04 
CORN to. Beet aif uw) ber reve © 05 
PEANUTS sate ne ahh canis tae dy A 06 ee 
OTHER: NUTS cz BBY cas nsssensesecsaccticcs 07 Be 
SOVPRODUCTSMOMes. of euoniemnen 08 | |e 
OTHER (SPECIFY) .oseesecsccsssscsssssseeessesseseen 09 a 


34. Has a doctor ever told (you/NAME) that (you have/he/she has): (CIRCLE A NUMBER FOR 


EACH) 
YES NO 
Diabetes 2s eaacennl eee comme te «reves ase nei ee Seer hoes eases tae 1 2 
High blood pressure (Hypertension)? ..............c:csccsscesceseeees 1 2 
Fleart CISCASE Gieaet a teat fescec en tetige crs creates aunts uae Gaserwcpanesniereho ches 1 2 
CANCE I iteereracre ssa eccrine censors cues MMT nse ca snaravaecied 1 2 
OsteOpor0sis? tin ee Ce nnn 1 2 
High DIOOd Cholesterol gy oeecgence sheet nc sdies catsuastathenssnccaseehocned 1 2 
SUOKG (oi iers cess teaser cae chars enn ee ee ee edede eee 1 2 


35. How many hours did (you/NAME) watch television or videotapes yesterday? 


SAMPLE PERSON IS... 


LESS THAN 12 YEARS OF AGE 1 (TIME ENDED) 
12 YEARS OF AGE OR OLDER 


15 


36. 


37. 


38. 


39. 


41. 


How often do you exercise vigorously enough to work up a sweat? 


TAN NG prep ether end er ke ER OAs See 1 

DO WIV Oi ry WE acne eee oy ee eee 2 

ea IMES PER WEEK cena eco 3 

ONCE AWE EK ee et ee 4 

Teer Meo MONT Hentai 5 

BUATAEDY COGUIN io erte ce ue eee eer: 6 
Have you smoked 100 or more cigarettes during your entire life? 

14 SS ac Seteale veel eee i aNaaes, CY a obec AC A 1 

NL} mea Beate st Oi tele aE ans Map te aed cere 2 (Q40) 
Do you smoke cigarettes now? 

bah eer aay ie seems Be eee neni fe 1 

ING ee ee ae ee 2 (Q40) 


On average, how many cigarettes per day do you smoke? 


| 
PER DAY 


The last few questions are about alcoholic beverages, including beer, ale, wine, wine coolers, 
liquor such as whiskey, rum, gin, and vodka, and mixed drinks containing liquor. 


During the past 12 months, that is, since last (NAME OF MONTH), have you consumed any 
alcoholic beverage? 


NC tee er ee re 2 (TIME ENDED) 


During the past 12 months, have you consumed any: 


YES NO 
EET Ga ART SEP oe eae SR pe eee ng Pe eer OR A 1 2 
VV ECCT WHIG COOICTS (mers netie ete eaters atice te cuansn sac yadiaranentvan 1 2 
Liquor, such as whiskey, rum, gin, or vodka, 
EOC CUITIKS COMLAI MN CQUOT (cect cereus cescqnrsncennransensiwendans 1 2 
Any other alcoholic beverages? ..........:.:cesceseeeeeeeseeteeeeeeees 1 2 
(SPECIFY) 


THANK RESPONDENT CODER USE ONLY. 
OUST a ae ee 


TIME ENDED AM 
PM 


INTERVIEWER OBSERVATION FORM 


[DO NOT READ THESE QUESTIONS TO THE RESPONDENT. ] 


A. WHO WAS THE MAIN RESPONDENT FOR THIS INTERVIEW? 


SAMBLEPERSONEY, te eee eee 01 
MOTHER OF SAMPLE PERSON ........s.ssssssesses000 02 
FATHER OF SAMPLE PERSON .........:-sssssssessss0ee: 03 
WIFE OF SAMPLE PERSON .........csscssssessssssseeeseee 04 
HUSBAND OF SAMPLE PERSON ........sssssssssss0ee: 05 
DAUGHTER OF SAMPLE PERSON .........::.ss.0000+- 06 
SON OF SAMPLE PERSON ..0.....scsssessssssesssssessseees 07 
SISTER OF SAMPLE PERSON .........s.csssessesssses0ees 08 
BROTHER OF SAMPLE PERSON ...........sssesss0-000 09 
GRANDPARENT OF SAMPLE PERSON ............... 10 
AUNT OF SAMPLE PERSON .......cscsccsssessssssssseeeee 11 
UNCLE OF SAMPLE PERSON .......scsesssssseseseeseeeen 12 
SOMEONE ELSE (SPECIFY) ......sssessscsssvsesesseseesees 13 


B. WHO, IF ANYONE, HELPED IN RESPONDING FOR THIS INTERVIEW? (CIRCLE ALL THAT 


APPLY) 

NO ONERAS Et feet oS ele eee 00 

SAMPLE PERSON To cca eee 01 

MOTHER OF SAMPLE PERSON .........sssssesseseee-0 02 

FATHER OF SAMPLE PERSON ..........sccceesssseseeere 03 

WIFE OF SAMPLE PERSON ........ccsesscsccsssssssseeseee 04 

HUSBAND OF SAMPLE PERSON .......sccesssess-s0-0 05 

DAUGHTER OF SAMPLE PERSON ..........:ssssscs000 06 

SON OF SAMPLE PERSON ....:.-..cccsssescsssceeceeseseees 07 

SISTER OF SAMPLE PERSON .........cccesccccscsssseeees 08 

BROTHER OF SAMPLE PERSON ........-cssssse-see000 09 

GRANDPARENT OF SAMPLE PERSON .............. 10 

AUNT OF SAMPLE PERSON ........-sssccesssscsecssssseees 11 

UNCLE OF SAMPLE PERSON ...0.....ccssseseeseseesseeee 12 = 

SOMEONE ELSE (SPECIFY) - OTHER | 
THAN INTERVIEWER ......-cccscccccssssescccecsssssssseeeees 13 


D. WHAT WAS THE REASON FOR THIS DIFFICULTY? 


17 


BOX 4 


SAMPLE PERSON IS... 


LESS THAN 12 
12 OR OLDER 


IS DATA RETRIEVAL NECESSARY FOR DAYCARE/BABY-SITTER/SCHOOL/OR OTHER 
CARETAKER? 


[IF YES, RECORD SOURCE INFORMATION ON FOLLOW-UP CALL RECORD ON HOUSEHOLD 
FOLDER. ] 


what we eatin 


WHAT WE EAT IN AMERICA: 1994-1996 
CONTINUING SURVEY OF FOOD INTAKES BY INDIVIDUALS 


Conducted for: 


United States Department of Agriculture 


Conducted by: 


Westat 
1650 Research Blvd. 
Rockville, MD 20850 


OMB #: 0586-0014 
Expires: October 31, 1996 


WHAT WE EAT IN AMERICA: 1994-1996 


DAY TWO INTAKE QUESTIONNAIRE 


PLACE CASE LABEL HERE 


SAMPLE PERSON #:|___ |_| 


INTERVIEWER NAME: 


INTERVIEWER ID: |_| |__| 


DATE OF INTERVIEW: |__| __|-|__|__|-19|__ |_| 
MO YR 


DAY OF INTERVIEW: INTERVIEW CONDUCTED: 


IN PERSON 
BY TELEPHONE 


FIRST NAME OF 


SAMPLE PERSON: FOR HOME OFFICE USE ONLY 


SERS SLA Fea Bel a DATE RECEIVED: 
oa VERIFIER ID: 
MC: 


BATCH #: 


Conducted for the United States Department of Agriculture 
by Westat Inc., Rockville, MD 
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DAY 2 


TIME STARTED AM 
aon memtinld a) 


HAND 'd like you to give me the list of everything (you/NAME) had to eat and drink all day 
CARD yesterday, (DAY), from midnight to midnight. I'll ask you for the detailed 
descriptions and amounts later. Please include everything (you/NAME) ate and 
drank at home and away -- even snacks, coffee, and alcoholic beverages. [DO NOT 
INTERRUPT RESPONDENT. USE HANDCARD I1 IF NECESSARY. ] 


[IF INFANT OR CHILD SP:] I'd like you to give me the list of everything (NAME) had to eat and 
drink all day yesterday, (DAY), from midnight to midnight. I'll ask you for the detailed 
descriptions and amounts later. Please include everything (he/she) ate and drank at home and 
away, including snacks and drinks (and bottles or breast milk). 


[WHEN RESPONDENT STOPS, ASK: Anything else?] 


Now I’m going to ask you the specific questions about the foods and beverages we just listed. 
When you remember anything else you ate or drank as we go along, please tell me. 


About what time did (you/NAME) begin to (eat/drink) the (FOOD)? [OR CONFIRM IF 
RECORDED ON QUICK LIST] 


Looking at this card, please tell me what (you/NAME) would call this occasion? [OR CONFIRM 
IF RECORDED ON QUICK LIST] 


HAND 01 BREAKFAST 
CARD 02 BRUNCH 
I2 03 LUNCH 
04 DINNER 
05 SUPPER 
06 FOOD AND/OR BEVERAGE BREAK 
SNACK 
ALCOHOLIC BEVERAGE 
OTHER BEVERAGE 
07 FEEDING (INFANT ONLY) 
08 OTHER (SPECIFY) 


BOX 1 


TRANSFER QUICK LIST FOOD TO GRID. CHECK OFF FOOD IN 
QUICK LIST AS IT IS TRANSFERRED. 


SEE FIB COLUMN Q4 FOR FOOD PROBES. 


[SEE FIB COLUMN Q5 FOR AMOUNT SPECIFICATIONS.] How much of this (FOOD) did 
(you/NAME) actually (eat/drink)? 


[ASK IF NOT OBVIOUS:] Did (you/NAME) have (NEXT QUICK LIST ITEM) with your 


(OCCASION) at (TIME) or was that at another time? 
[IF SAME OCCASION, GO BACK TO BOX 1. IF ANOTHER TIME, GO BACK TO Q2.]} 


INDIVIDUAL INTAKE FORM 


Occ. 
(HAND- Food/Drink 
CARD I2) and Additions 


hk 
=k 


— 
ie) 


i 
Oo 


Q4 
Description of Food/Drink 
and Ingredient Amount 


Q5 Q7 Qs Q9 
How much of this Where Eaten At Ever At 
(FOOD) did you Obtained | Home Home 
actually (eat/drink)? (HAND CARD I3) 


INDIVIDUAL INTAKE FORM (continued) 


Q3 Q4 
Occ. 
(HAND- Food/Drink Description of Food/Drink 
CARD I2) and Additions and Ingredient Amount 


Q5 : Q7 Qs 
How much of this Where Eaten At 
(FOOD) did you Obtained Home 
actually (eat/drink)? (HAND CARD I3) 


INDIVIDUAL INTAKE FORM (continued) 


Q3 Q4 
Occ. 
(HAND- Food/Drink Description of Food/Drink 
CARD I2) and Additions and Ingredient Amount 


Q5 Q7 Qs Q9 
How much of this Where Eaten At Ever At 
(FOOD) did you Obtained Home Home 
actually (eat/drink)? (HAND CARD I3) 


REVIEW: Now let’s see if | have everything. I'd like you to try to remember anything else (you/NAME) 
ate or drank yesterday, that you haven’t already told me about, including anything 
(you/he/she) ate or drank while preparing a meal or while waiting to eat. 


a. At (EARLIEST TIME) (you/NAME) had (FOODS) for (EARLIEST OCCASION). . . 
Did (you/he/she) have anything else to eat or drink before that, starting at midnight? 


b. Next, at (TIME) (you/he/she) had (FOODS) for (OCCASION). . . 
Did (you/he/she) have anything else to eat or drink with that (LAST OCCASION) or between 
(OCCASION) at (LAST TIME) and (THIS OCCASION) at (THIS TIME)? 


[REPEAT b FOR EACH OCCASION] 


c. Did (you/he/she) have anything to eat or drink yesterday after (LAST TIME) but before midnight? 


Now let’s go back to the beginning of the day and find out where (you/NAME), or other people who live 
here, obtained the food (you/he/she) ate and where (you/he/she) ate it. 


Th. (Looking at this card,) Where did (you/he/she) obtain this (FOOD/MOST OF THE 


INGREDIENTS FOR THIS FOOD)? 


HAND 01 STORE, SUCH AS 09 SOUP KITCHEN, SHELTER, FOOD PANTRY 
CARD SUPERMARKET, GROCERY STORE, 10 MEALS ON WHEELS 
13 OR WAREHOUSE, CONVENIENCE 11. OTHER COMMUNITY FOOD PROGRAM 
STORE, DRUG STORE, OR 12 GROWN OR CAUGHT BY YOU OR SOMEONE 
GAS STATION YOU KNOW 
SPECIALTY STORE SUCH AS BAKERY, 
DELI, SEAFOOD, ETHNIC FOOD, IF FISH OR SEAFOOD, ASK: Did it come from a... 
HEALTH FOOD 71 Freshwater lake, pond, or river 
COMMISSARY 72 The ocean, or 
PRODUCE STAND OR FARMER’S 73 A bay, sound, or estuary? 
MARKET 74 DON’T KNOW BODY OF WATER 
02 RESTAURANT WITH WAITER/WAITRESS 
SERVICE 13 SOMEONE ELSE/GIFT 
03 FAST FOOD PLACE, PIZZA PLACE 
04 BAR, TAVERN, LOUNGE SOME OTHER PLACE (PLEASE DESCRIBE) 
05 SCHOOL CAFETERIA 14 MAIL ORDER PURCHASE 
06 OTHER CAFETERIA 15 COMMON COFFEE POT OR 
07 VENDING MACHINE SNACK TRAY 
08 CHILD CARE CENTER, FAMILY DAY 16 RESIDENTIAL DINING FACILITY 
CARE HOME, ADULT DAY CARE 17 OTHER (SPECIFY) 
98 DON’T KNOW 
8. Did (you/NAME) (eat/drink) this (FOOD) at your home? 
IF YES, GO BACK TO Q7 FOR NEXT FOOD. 
IF NO, GO TO Qg. 
9. Before (you/NAME) (ate/drank) this particular (FOOD), was it ever at your home? 


REPEAT Q7-9 FOR EACH FOOD. 


10. Was the amount of food that (you/NAME) ate yesterday about usual, less than usual, or more 
than usual? 


US WAH ING: Bein SAM HR EMA AEAER teeltonssess 1 (Q13) 
CESS THAN-DUSUAL At. Sirah ists... 2°(Q11) 
MORE.THAN USUAL ite. dteriti te 1.n2. 3 (Q12) 
AP What is the main reason the amount (you/NAME) ate yesterday was less than usual? 
SICKNESS# Ase iA 01 
SHORT OF MONEY ot prtetes. satocereanansesavest 02 
TRAVELING Sortie. cotnersvtgtsetiee tects 03 
AT A SOCIAL OCCASION OR 
ONTASPECIAL DAY Sik: ac-cnneenren se 04 
ON VAGATION ME. ifs-2-seiteestts.saueenerscey 05 
TOGEUS IME uel. acennen. Sh pert fan et 
NOTHAHUNGRY seiiisR ccccaes ce 07 
DIETING ire tote. veces re Die czeneenrerin 08 
gts SANG RIS. > | se eeereee oper R eR Beene em 09 
BGREUIOR GRE OED vee eee 10 
SOME OTHER REASON (SPECIFY) ....... 11 
| 
12. What is the main reason the amount (you/NAME) ate yesterday was more than usual? 
AFA VEELIN GO With ise ccescareectecse-apeoecs 1 
AT A SOCIAL OCCASION OR 
ONSAISPECIAL DAY Cotes sararitecrsectersens 2 
ONIVAGATION 2G et Ok na oea oe cetseees 3 
VERYVIMUNG RY septs ose ena sce cpveeennts 4 
BOREDJOR STRESSED sec reeosceae soesenenotes 5 
SOME OTHER REASON .............----.scse00s 6 
(SPECIFY) | 


Now I'd like you to think about all of the plain drinking water that (you/NAME) had 


yee yesterday, regardless of where (you/he/she) drank it. By plain drinking water, | mean tap 
15 water or any bottled water that is not carbonated, with nothing added to it, not even lemon. 


13. How many ounces of plain drinking water did (you/he/she) drink yesterday? 


One 
OUNCES 
NONE PET oc cfocciioctgettecsoancrnnenansasspers 000 (Q16) 
14. How much of this plain drinking water came from your home? Would you say all, most, some, or 
none? 

1 DE et Ae ere ni mi Ae RE a 1 (Q16) 
MOST ier cesta eet tener rit ae 2 

SOOM rere irre eee ence 3 

a | <aaponetpcneyeenparenttey Dia enlis nr ntrene MDS RIAs 4 


15. 


16. 


Ve 


What was the main source of plain drinking water that did not come from your home? Was it tap 
water, water from a drinking fountain, bottled water, or something else? 


TAP WATER AND/OR DRINKING FOUNTAIN .....cccccscssccssscsceeseeeeees 1 
BOTTLED WATER MMR Dean Cee eereing at peerings 2 
OTHER SOURCEAE NI td SEIN a foicboccsscstcilisescstonstgesthre ee 3 

(SPECIFY) | ia 
DON'T KNOW (ii taneeitar i an cannt en OS LNT PER 8 


How many hours did (you/NAME) watch television or videotapes yesterday? 


MEAP | 
# OF HOURS 


During the past 12 months, that is, since last (NAME OF MONTH), (have you/has NAME) eaten 
any (FOOD) in any form? 


YES NO YES NO 

Artichokes See eee 1 2 Grapefruit, other than juice ............. 1 2 
ASDAaragus ites eee 1 2 Cantaloupe W.1.eccrette scccareneseeee 1 2 
BIrOCCOIIS.. cnc ctu vente 1 2 Honeydew melon .............cescsseeeees 1 2 
Brussels sprouts ...............:csescceees 1 2 Watermelon eres sve tee cater 1 2 
Cauliflower 21. .ccen en eee ete 1 2 Nectarines 2c.2e.accion..sam.eres 1 2 
Eqoplant t:n.0 etre cer eee: 1 2 PEAIMS: ccocoteccdsteecesec eter nee ee eer ee 1 2 
KAIC ics. Meccaee eer he eee ee 1 2 PRIUS, ec rccdie cranes te napeat ah ee 1 2 
Swiss’ chard eee ens 1 2 Rhubarb es. sertetccc tetris ecm eaee 1 2 
OK ea a vcccr eee Se eee ian can ee 1 2 Chicken liveries. ai woare icc ees 1 2 
Spinach secrete arcccee eae cter: 1 2 Beef, veal or pork liver .................0++ 1 2 
Summer squash (thin skin) ........... 1 2 Lamb.” co... dete. eee. cee ae 1 2 
Winter squash (hard skin) ............. 1 2 Shellfish Fae. ceectcertacste toate nee 1 2 
Sweet potato or yams ................... 1 2 Fish, other than shellfish 
Turnips, other than greens ............ 1 2 oe EVES Soee ete ely bee J 
Avocado or guacamole ................. 1 2 fish you ate caught by 

you or someone you know? ...... 1 2 


THANK RESPONDENT CODER USE ONLY. 


QUST: | aja 


TIME ENDED AM 
PM 
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INTERVIEWER OBSERVATION FORM 


[DO NOT READ THESE QUESTIONS TO THE RESPONDENT. ] 


A. WHO WAS THE MAIN RESPONDENT FOR THIS INTERVIEW? 


SAMPLE. PERSONM.«-0--c Aone. woes 01 
MOTHER OF SAMPLE PERSON ........sssssscssssee0000 02 
FATHER OF SAMPLE PERSON .........sssesssssseseeseee 03 
WIFE OF SAMPLE PERSON .........sscsssssesssssseseeeeee 04 
HUSBAND OF SAMPLE PERSON .........ssseseesse00-0 05 
DAUGHTER OF SAMPLE PERSON ........ss-ssess00000 06 
SON OF SAMPLE PERSON ....cesssscccssssesessesesseseee 07 
SISTER OF SAMPLE PERSON ........ccsssesessssssessese 08 
BROTHER OF SAMPLE PERSON .........-scssssseeseee 09 
GRANDPARENT OF SAMPLE PERSON .............. 10 
AUNT OF SAMPLE PERSON ........sssssesssssssssesseseees 11 
UNCLE OF SAMPLE PERSON .......ssssssssseesssseeeeee 12 
SOMEONE ELSE (SPECIFY) ..0.-...-ccccccessessseseeseee 13 | 


B. WHO, IF ANYONE, HELPED IN RESPONDING FOR THIS INTERVIEW? (CIRCLE ALL THAT 


APPLY) 

NCHONEGaeeeerr re rts ok a ee nr 00 

SAMPLE PERSON+) 0 so cee 01 

MOTHER OF SAMPLE PERSON ...........sssssesse0000 02 

FATHER OF SAMPLE PERSON ..........-sssssseeeseeee-0 03 

WIFE OF SAMPLE PERSON ........ssssssssesssssssseeseee 04 

HUSBAND OF SAMPLE PERSON .........se::::s000000 05 

DAUGHTER OF SAMPLE PERSON ...........s::00-0-+ 06 

SON OF SAMPLE PERSON .....sssssssssssssseeesseseeeeen 07 

SISTER OF SAMPLE PERSON ......e.ssccssssssssseeee 08 

BROTHER OF SAMPLE PERSON ..........ssessese000-0 09 

GRANDPARENT OF SAMPLE PERSON .............. 10 

AUNT OF SAMPLE PERSON .........ssssessssssssssseseees 11 | 

UNCLE OF SAMPLE PERSON ...u...:.ssssssessscsessss00e 12 | 

SOMEONE ELSE (SPECIFY) - OTHER ae 
THAN INTERVIEWER ....-ss----sscsssssssssessssssssssssesses 13 l 


C. DID YOU OR THE RESPONDENT HAVE DIFFICULTY WITH THIS INTAKE INTERVIEW? 


11 


BOX 4 AND QUESTION E NOT ASKED FOR DAY 2. 


fe IS DATA RETRIEVAL NECESSARY FOR DAYCARE/BABY-SITTER/SCHOOL/OR OTHER 
CARETAKER? 
EY ES Se. cass enisctssesireetieiicee ae ee 1 
NOC, She ee sacs ssepsanspsasatensasscossen 2 


[IF YES, RECORD SOURCE INFORMATION ON FOLLOW-UP CALL RECORD ON HOUSEHOLD 
FOLDER. ] 
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THIS PAGE INTENTIONALLY BLANK 


what we eat In 


1994-96 


WHAT WE EAT IN AMERICA: 1994-1996 
CONTINUING SURVEY OF FOOD INTAKES BY INDIVIDUALS 


Conducted for: 


United States Department of Agriculture 


Conducted by: 


Westat 
1650 Research Blvd. 
Rockville, MD 20850 


OMB #: 0586-0014 
Expires: October 31, 1996 


WHAT WE EAT IN AMERICA: 1994-1996 


DIET AND HEALTH KNOWLEDGE 
SURVEY QUESTIONNAIRE 


PLACE CASE LABEL HERE 


[BE SURE TO PREPARE QUESTIONNAIRE BY MARKING 
RANDOM STARTS BEFORE CONTACTING RESPONDENT. ] 


RANDOM START LABEL 


INTRODUCTION: (ASK TO SPEAK WITH SAMPLE PERSON.) 

Hello, | am (YOUR NAME) from Westat. (I/We) spoke with you recently as part of the food survey Westat 
is conducting for the United States Department of Agriculture. At that time (I/we) said (I/we) would get 
back in touch with you to ask a few more questions about your opinions on your diet, health, food 
shopping, and related topics. Before | begin, | just need to verify your name and age to make sure that | 
am interviewing the correct person. Is this (NAME OF SAMPLE PERSON)? And you are (about) (AGE) 
years old? (IF NOT CORRECT SAMPLE PERSON, THANK RESPONDENT AND ATTEMPT TO SPEAK 
WITH CORRECT SAMPLE PERSON.) 


SAMPLE PERSON #:|__|__ 


INTERVIEWER NAME: eee [eee ee 


TIME STARTED 


| Sees ees) eee ee 
TIME ENDED 


CONDUCTED: 


IN PERSON 
DAY OF INTERVIEW: BY TELEPHONE 


INTERVIEWER ID: | |_ 


DATE OF INTERVIEW: |__|__ 


SP’S FIRST NAME: 


DATE OF BIRTH: |__|__|-|__|__ 
MO DAY DATE RECEIVED: 


VERIFIER ID: 
MC: 
BATCH #: 


Conducted for the United States Department of Agriculture by Westat Inc., Rockville, MD 
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TIME STARTED AM 


Let’s begin by talking about the number of servings from different food groups that a person should eat 
each day. How many servings from the (FOOD GROUP) would you say a person of your age and sex 
should eat each day for good health? (DO NOT ACCEPT A RANGE OF SERVINGS.) 


What about the (NEXT FOOD GROUP)? 


IF ASKED, SAY: “Count as a serving whatever you consider a serving to be.” 


a | NUMBEROF | DONT _ 
FOOD GROUP _ | SERVINGS [| © 


bd b. Vegetable Group? pqrmetas ie Abe BED Sie] 
[emi vogut ance? Pf 
[elcome econo liana) 
ee 


START 
AT "xX" 


fh 


Now | am going to read some statements about what people eat. Please tell me if you strongly agree, 
somewhat agree, somewhat disagree, or strongly disagree with the statement: (READ STATEMENT) 


What about (NEXT STATEMENT)? 


IF NEEDED, SAY: "Do you strongly agree, somewhat agree, somewhat 
disagree, or strongly disagree with the statement?" 


Choosing a healthy diet is just a matter of 
knowing what foods are good and what foods 
are bad. 


Eating a variety of foods each day probably gives 
you all the vitamins and minerals you need. 


Some people are born to be fat and some thin; 
there is not much you can do to change this. 


Starchy foods, like bread, potatoes, and rice, 
make people fat. 


There are so many recommendations about 
healthy ways to eat, it’s hard to know what to 
believe. 


What you eat can make a big difference in your 
chance of getting a disease, like heart disease or 
cancer. 


The things | eat and drink now are healthy so 
there is no reason for me to make changes. 


3. Next, let’s talk about your own diet. Compared to what is healthy, do you think your diet is too low, too 
high, or about right in (STATEMENT)? 


What about (NEXT STATEMENT)? 


IF NEEDED, SAY: "Would you say your diet is too low, too 
high, or about right in that?" 


IF NEEDED, SAY: “The question is asking about nutrients from 
foods, not from vitamin pills.” 


. Lee ee 
AT "X" 
[a eee pe fe Pe 
io a ik 


Si a eo 


e. Protein? 


= aed ae 
i be sho jer 
| g. Saturated fat? pia) | eoeee| ais 
ea h. Cholesterol? pias 
ea i. Salt or sodium? pit) els 
firme emer 
aes a lees 


k. ee and sweets? 


"STATEMENT 


4. To you personally, is it very important, somewhat important, not too important, or not at all important to 
(STATEMENT)? 


To you personally, how important is it to (NEXT STATEMENT)? 


IF NEEDED, SAY: "Is that very important, somewhat important, not too 
important, or not at all important to you personally?" 


IF NEEDED, SAY: “The question is not asking about your actual eating habits, 
it is asking about the importance of the statement to you 


personally." 


START |] | a. Use salt or sodium only in 
AT *X" moderation? 
Choose a diet with plenty of fruits 


and vegetables? 


<i aaa 
Co 
[ewer fe pe Pe fo fe 
[a temanemiene ff fe [fe 
[x omnsonmnse f= fps |e fs fe 
[ie eecnsommnaneenr fe f= |e | fe 


Choose a diet with plenty of breads, 
cereals, rice, and pasta? 


Eat at least two servings of dairy 
products daily? 


ec |aa) (Ad1IOadS) 
00 | ZI 

Pon (AsIO3dS) 
OOs Eze 

| (As1IO3dS) 
00 | ZI 

bagrat (Asd1IO3dS) 
00 | ZI 
OO eZ} 

faalae | (AdIO3dS) 
00 | ZI 
00 | ZI 
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if Do you consider yourself to be: 


OVEIWSIQMI, ehecsnscocvosendeecrdes siuenscepuconnattvcepee ste eee 1 
UMGSIWCIGIN POF fo... susecescdeecssececdvenussatesnpes ereeate 2 
ADOUIt FiQhHt? © So.scccecnccsteesogeeyecente esse eee 3 

8. Based on your knowledge, which has more saturated fat: (READ EACH PAIR STARTING AT "X" AND THEN 


WAIT FOR AN ANSWER. DO NOT PROBE "DON’T KNOW" ANSWERS.) 


Liver, or 

Tebone steak rctcgrc arc 
THE SAME 

DON’T KNOW 


Butter, or 
Margarine treat ee 
THE SAME 


Egg white, or 
OG VOU ie nee lances ccce ere meet 
THE SAME 


Skim milk, or 
Whole milk? tien 2ere eee 
THE SAME 


Which has more fat: (READ EACH PAIR STARTING AT "X" AND THEN WAIT FOR AN ANSWER. DO NOT 
PROBE "DON’T KNOW" ANSWERS.) 


START | a. Regular hamburger, or 
AT “X" CTOUNIC! TOUNNC 2 openness cree sree 


Loin pork chops, or 

Pork Spare rDS7 o....seresadccesashavessscszesdansee 
THE SAME 

DON’T KNOW 


Hot dogs, or 
i Fl Pe ane, apa A nen etl a 
THE SAME 


DON’T KNOW 


Peanuts, or 

POCO Cae ah seca assncniecneebeseeaceceeesancer 
THE SAME 

DON’T KNOW 


Yogurt, or 

SOURCTCAIN Corerrrecceccsetrrstecectrncceresees 
THE SAME 

DON’T KNOW 


Porterhouse steak, or 

ROUNG SOAK? Bo ccccsccecascerstccetssceserecsstess: 
THE SAME 

DON’T KNOW 


DO NOT PROBE "DON’T KNOW" ANSWERS FOR Q10-14. 


Which kind of fat is more likely to be a liquid rather than a solid: 


Saturated: fateh .csccsde.ccsts cctevecsoorser-mteose-eceecces dees: a 
Polyunsaturated fats, OF .........ssssesssssesescsseeeeees 2 
Are they equally likely to be liquids? ............... 3 
DONT KNOW Go csctececussngsvecne uot pete cemeewes 8 
If a food has no cholesterol is it also: 
EOw,in Saturateditateweetseete.c.0-crecesrsseeeereece ss 1 
igh im Saturated fell, Of  2...ccnacccsesnencteessrareney cre 2 
Could it be either high or 
low in Saturated fat? ............ cesseesseeseesseeeeeee 3 
DOIN KNOW ose hecs cece ccs eteatnce ans vec ae 8 
Is cholesterol found in: 
Vegetables and vegetable oils, ................00+ 1 
Animal products like meat and 
Galry PlOCUCTS SOME vcescecevsenronnsenaettcasenssesteames 2 
All foods containing fat or O81? 0... eee eeeeeeee 3 
DON IL RNOWE 2c ccstecassssdsastsnsvseuerstnssortoe eae 8 


If a product is labeled as containing only vegetable oil is it: 


LOw:iniSaturated fate ..c..cccssscteseseccnusestsesteraceres 1 
FIOM Ma SAU ALCO) tell OF 8 oe crcn crc eyarnce seas 2 
Could it be either high or low 

Ud SALLICENCC Tell Oo kere caccsentuavrnen scare eaalesecuseaes 3 
LION RONG IVY aacus ce chaos tansvacscaeleosceichemseaspesteae ce 8 


If a food product is labeled "light," does that mean that compared to a similar product not labeled “light” it is 
lower in calories, lower in fat, or lower in calories and/or fat, or does it mean something else? 


LOWERIN CALORIES rien we testi nente, 1 
LOWERUIN EA eerie eee ee 2 
LOWER IN CALORIES AND/OR FAT ............. 3 
SO MEM MING ELSE tere scree ee eter cee 4 
DONG KNOW nt etrseens ech eae reerre 8 


15. Now think about buying food. When you buy food, how important is (FACTOR) — very important, somewhat 
important, not too important, or not at all important? 


What about (NEXT FACTOR)? 


IF NEEDED, SAY: “How important is (FACTOR) — very important, somewhat 


important, not too important, or not at all important?" 


| Somewhat | No i a 
Important 1 mp ort 


Very 
ee 


START 
AT "X° 


Nutrition? 


Ce Bee nl 
Fi ste cf pec EE 
a i a | mn a 


16. Now think about food labels. When you buy foods, do you use (SECTION) often, sometimes, rarely, or never? 


What about (NEXT SECTION)? 


IF NEEDED, SAY: “Do you use (SECTION) often, sometimes, rarely, or never?" 


a. The list of ingredients? aaaytaen| ts 2a 


AT "X" 
b. |The short phrases like "low-fat" or 
"light" or "good source of fiber"? 1 2 


c. The nutrition panel that tells the 
amount of calories, protein, fat, and 
such in a serving of the food? 


d. The information about the size of a 
serving? 


e. Astatement that describes how 
nutrients or foods and health 
problems are related? 


BOX 1 


IS "NEVER’ (4) OR "NEVER SEEN" (5) CIRCLED FOR ALL PARTS OF QUESTION 16? 


1 (Q24) 
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We When you look for nutrition information on the food label, would you say you often, sometimes, rarely, or 
never look for information about (STATEMENT)? 


What about (NEXT STATEMENT)? 


IF NEEDED, SAY: "Would you say you often, sometimes, rarely, or 


never look for information about that?" 


i on _ STATEMENT | 


T [a comet 

bal b. Salt or sodium? |e aie 
[Ec = ee 
a 
en (aS GM 
T[e werinsormnwae | + | 2 [3s | + 
a ae a | a a 
[CS | Ke 


18. Now think about the types of food products you buy using food labels. When you buy (FOOD PRODUCT), 
do you look for nutrition information on the food label often, sometimes, rarely, or never? 


What about (NEXT FOOD PRODUCT)? 


START 
AT "X" 


WD | Ww 


IF NEEDED, SAY: “And when you buy (FOOD PRODUCT), do you use the 


label often, sometimes, rarely, or never?" 


a. Dessert items like cookies or cake | 
mixes? 2 3 4 


pemmermereiociacts |. [| 

pretzels? 2 3 4 

Epa n 
Pa 


START 
AT "X*" 


4 
4 
4 
4 
4 | 


_| NEVER | DO NOT 


| Rarely | Never | SEEN | BUY _ 


i. Raw meat, poultry, or fish? 
j. Processed meat products like hot dogs 
and bologna? 


[Fan 

, pe 

es 

eee Se Pe 

[me] 
: i 

ease 

pear rie a 


‘a h. Table spreads like butter or margarine? 


~ FOOD PRODUCT 
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19. 


Now think about the types of nutrition information on food labels. Do you think (SECTION) is very easy to 
understand, somewhat easy, or not too easy to understand? 


What about (NEXT SECTION)? 


IF NEEDED, SAY: "Would you say that is very easy to understand, somewhat 
easy, or not too easy to understand?" 


START rie a. The list of ae aren es 
AT “X" 
b. A short phrase like "low-fat" or "light" 
or "good source of fiber"? 


20. 


START 
AT "X* 


c. The number of calories in a serving? 


d. The number of calories from fat ina 
serving? 


\e e. The number of grams or milligrams of 


nutrients like fat and sodium in a 


serving? 


f. The percent of the daily value for each 
nutrient? 


g. Adescription like “lean” or “extra lean" 
on meats? 


If a food label says a food is (DESCRIPTION), would you say you are very confident, somewhat confident, 
or not too confident that the description is a reliable basis for choosing foods? 


What about (NEXT DESCRIPTION)? 


IF NEEDED, SAY: “How confident are you that the description 
is reliable? Would you say very confident, 
somewhat confident, or not too confident?" 


_DESCRI PTION 


Low-fat? 


Low-cholesterol? 


Healthy? 


Extra lean? 


Ans 


ee. 


START 
AT "X" 


As far as you know, does the government define and enforce the meaning of the phrase (PHRASE) on food 
labels? (DO NOT PROBE "DON’T KNOW" ANSWERS.) 


What about the phrase (NEXT PHRASE)? 


e PHRASE 


en Low-cholesterol? 
Efe Light? 
Aiea | 


Now think about the section of the food label that tells the amount of calories, protein, and fat in a serving of 
the food. If it showed that one serving of the food contained (AMOUNT OF NUTRIENT), would you 
consider that to be a low amount or a high amount? (DO NOT PROBE "DON’T KNOW" ANSWERS.) 


What about (NEXT AMOUNT OF NUTRIENT)? 


IF NEEDED, SAY: “Would you consider that to be a low 


amount or a high amount for one serving 
of food?" 


ate a. 100 milligrams of sodium? ap 
4 b. 20 grams of fat? a 
ars c. 15 milligrams of cholesterol? iateede 
and d. 5 grams of fiber? | eed 
| fe atc 


10 grams of saturated fat? 
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Now | am going to read some statements. Please tell me if you strongly agree, somewhat agree, somewhat 
disagree, or strongly disagree with the statement: (READ STATEMENT) 


What about (NEXT STATEMENT)? 


IF NEEDED, SAY: “Do you strongly agree, somewhat agree, somewhat disagree, or 
strongly disagree with the statement?" 


STATEMENT > | Agree — yee | 


. The nutrition information on food 
labels is useful to me. 


. | feel confident that | know how to use 
food labels to choose a healthy diet. 


. The nutrition information on food 
labels is hard to interpret. 


. Reading food labels takes more time 
than | can spare. 


| read food labels because good 
health is important to me. 


| would like to learn more about how 
to use food labels to choose a 
nutritious diet. 


. Reading food labels makes it easier to 
choose foods. 


. Sometimes | try new foods because of 
the information on the food label. 


When | use food labels, | make better 
food choices. 


Using food labels to choose foods is 
better than just relying on my own 
knowledge about what is in them. 


bier bot Ba 
ans 


STATEMENT 


GO TO Q26 
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24. Now | am going to read some statements about food labels. Please tell me if you strongly agree, somewhat 
agree, somewhat disagree, or strongly disagree with the statement: (READ STATEMENT) 


What about (NEXT STATEMENT)? 


IF NEEDED, SAY: "Do you strongly agree, somewhat agree, somewhat disagree, or 
strongly disagree with the statement?" 


_ STATEMENT 


. | feel confident that | know how to use 
food labels to choose a healthy diet. 


. The nutrition information on food 
labels is hard to interpret. 


Reading food labels takes more time 
than I can spare. 


. | would like to learn more about how 
to use food labels to choose a 
nutritious diet. 


. Using food labels to choose foods 
would be better than just relying on 
my own knowledge about what is in 
them. 


20. As far as you know, does the government define and enforce the meaning of the phrase (PHRASE) on food 
labels? (DO NOT PROBE "DON’T KNOW" ANSWERS.) 


What about the phrase (NEXT PHRASE)? 


Low-cholesterol? 


Light? 


Extra lean? 
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26. Now think about the foods you eat. Would you say you always, sometimes, rarely, or never (HABIT)? 


What about (NEXT HABIT)? 


a. 


f, 


g. 


2 


IF NEEDED, SAY: “Do you always, sometimes, rarely, or never (HABIT)?" 


Eat lower-fat luncheon meats instead of 

regular luncheon meats? (IF NEEDED, SAY: 
“Examples of lower-fat luncheon meats are deli 
ham and turkey. Examples of regular luncheon 
meats are bologna and salami.") 


Use skim or 1% milk instead of 2% or whole 
milk? 


Eat special, low-fat cheeses, when you eat 
cheese? 


Eat ice milk, frozen yogurt, or sherbet instead 
of ice cream? 


Use low-calorie instead of regular salad 
dressing? 


Have fruit for dessert when you eat dessert? 


Eat fish or poultry instead of meat? (IF 
NEEDED, SAY: "Meat refers to beef, pork, or 
lamb." 


When you eat baked or boiled potatoes, how often do you add butter, margarine, or sour cream? Would 


you say always, sometimes, rarely, or never? 


ALWAYS (ALMOST ALWAYS) ........c.ccceseseseeees 1 
SOMETIMES Fatercs.-Scrsn hast meer ote hence, 2 
alalall ih ¢ Baie eas Leni Pract, dele 3 
SNA Bee ae TOU a enencihecancne Seve, TER a 
DO NOT EAT BAKED OR BOILED 
SME] 5 hae el On elie rem omen, ORE 0 
16 


28. 


29. 


30. 


31. 


32. 


When you eat other cooked vegetables, do you always, sometimes, rarely, or never eat them with butter or 


margarine added? 


ALWAYS (ALMOST ALWAYS) 
SOMETIMES 
RARELY 
NEVER 


ee ececereresescccecscese 


Neneeccceseceseseserssesccsscessscesseseseseseeesse 


ee wee ec scenes cee eee eer esessececcsssesseasosesssesscsssoee 


secccscese 


When you eat other cooked vegetables, do you always, sometimes, rarely, or never eat them with cheese or 


another creamy sauce added? 


ALWAYS (ALMOST ALWAYS) 
SOMETIMES 
RARELY 


wee eeeeeasoressecescsces 
Peewee cece ee eeccsecennaseassasseneseesavesesessees 
Pwo eee coeece sae ssaseseesoessesecsscerscseseeuesesasesscsens 


Peewee ese rccce reese esos eee ssesoaccesseeessesseseussssssscese® 


When you eat chicken, do you always, sometimes, rarely, or never eat it fried? 


ALWAYS (ALMOST ALWAYS) 
SOMETIMES 
RARELY 
NEVER 


eee ecccsescseseccosccccs 
Cece reece reer re serescascesssessssssesesesssscssoess 
Oe eee cw cecerencsesesescesasccesceessesessseseesseseseosess 
Peer ec cerecccsc cesses esse se ee soreness eDesssseseesessosessasenD 


eee ecceeeeccceceseesescsoscessesee 


When you eat chicken, do you always, sometimes, rarely, or never remove the skin? 


ALWAYS (ALMOST ALWAYS) 
SOMETIMES 
RARELY 


Perrerrrrrrrrrrirrr rir 
eee rerer recess soserescccsosscssessosessesssesoeess 
Cee m cree scce score cece cereresscccesessosceeseesenesecenssene 


emcee cece sees essere soe sesso serases eee nas esseseecessasoerenS 


Peewee eee a rose ase ess eee sees ese oesseseo De een eouessaeeseeseseoee 


LCS NMEIE Bu tM ARE caren sore occ deruenscaGhensditestiacseeys 
Moderate sane 25 eer ew aero 
GONnerOUS career eis 
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33. 


36. 


37. 


About how many times in a week do you eat (FOOD) -- 


‘tessthan}| 
week 


(| (Neve) | 130 | 48 


Bakery products like cakes, cookies, or 


donuts? 


And at your main meal, about how many times in a week do you eat beef, pork, or lamb. Would you say 


less than once a week, 1-2, 3-4, or 5-7 times? 


LESS THAN ONCE A WEEK/NEVER ............. 
AZO IMME SER Sao o cay ca-tenspact-konsneresasshentscruesncss 
ce! NLS open Hien iinest eam S Ai aRE tes 


When you eat meat, do you usually eat: 


IF ASKED, SAY: 


; ST | WR ne Sita mtink care ee SENE Reem AE BO TB 
"The question 


is asking about 
meats, like beef, 
pork, or lamb." 


LUG! POMMONNS 0 esecscns eo eect seven raees eens 
LO N@ JoBASMEA Tite on ccncosscesete sscssersocel 


less than once a week, 1-3, 4-6, or 7 or more times? 


When you eat meat and there is visible fat, do you trim the fat always, sometimes, rarely, or never? 


ALWAYS (ALMOST ALWAYS) .....ce--ssseeeessseeees 
SOMETIMESH cee ee als 
RARELY 
NEVER 


SOOO eS Seer HOSE OES EOE ERTS OSES ESSE DO EBS EEE SESE EEE EEE EESSEOe 


SOR es Oo se reesseveseeesseresseeeeesesOeosOeE DE Dessesesesosese 


How many eggs do you usually eat in a week — less than one, 1-2, 3-4, or 5 or more? 


IF ASKED, SAY: 


TThe question te LESSHIHAN ONE/NONE eco nase 
; LE ca anne ere veneer Seer OMe Teuln Tie Lent, 
asking about 3-4 
Pe arr er etc? cx ceeeremrerrserepen prreretecie mtriree oe meenoneve rn 
plain eggs, not 5 OR MORE 


Cee wee recerscesosoreserese se enereceecesaseeescesseee 


egg substitutes 
or eggs in mixed 
dishes or baked 
goods." 


18 


38. Before you eat fresh fruits and vegetables, do you or does someone else wash them always, sometimes, 


rarely, or never? 


ALWAYS (ALMOST ALWAYS) ...........:::c02s0e000 1 
SOMEMIUMES tee cree ioe iticcs tensccoee Bh sener 2 
RARELY @.....:0.<00.i:.. Stee ae. ee. 3 
NERVE IMG Se. fe i acer) Pac cttennste ie Miecanedece Myatt 4 
DGINF TAK NOW. <.002<05n125 0 -Mtaepatitac p< onettenn- at 8 
DO NOT EAT FRESH FRUITS / 
VEGE FABLES vi aicccscsct petee cr snkrnasect cache eee 0 (Q42) 
39. When you eat fresh fruits with peels that can be eaten, do you eat the peel always, sometimes, rarely, or 
never? 
ALWAYS (ALMOST ALWAYS) ..........::cscecceceee 1 
SOMETIMES. Setiepe .-c.or- ssc cpss- ces cocdeonzieote tte 2 
PARE DY ets cnventennaeret tyiceire ceee rane ees 3 
NEVER Gre arse See Tate ethan tind Xe 4 
DONDRKNOW dete < 2.5 gehecece Beeches oe. 8 
40. When you eat fresh vegetables with peels that can be eaten, do you eat the peel always, sometimes, rarely, 
or never? 
ALWAYS (ALMOST ALWAYS) .............::0000000 1 
SOBAB TIMES Sorrento ee ease ccunter ons 2 
BARELY Gseee...22)...5 gee ttsnoes ee eee ees 3 
NEVE pets tees rater ace wart teaver tcencence 4 
BLO] Nl ial NTO) aly 2.26 <5 oe, ane 8 
41. Do you eat the outer leaves of leafy vegetables like lettuce and cabbage? 
IF NEEDED, SAY: “What es i de A PME la le lena i eee E 
be ge most cme DONT KNOWnt te 8 
ee DO NOT EAT LEAFY VEGETABLES ............. 0 
42. Are you the person most responsible for planning or preparing the meals in your household? 
NAEP Sis, ky y Lege ee ee ee ee eee 1 
INC ere pe ner ices ere eee cere uses cca ulasliness Upcvease 2 
COOONGTICNOVV gece ocr pertcess ccrnssaesccaesatetiossnctee 8 
THANK YOU FOR YOUR TIME AND COOPERATION 
TIME ENDED AM 
PM 
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Attachment 3.B 
Summary of Revisions to Day 1 and Day 2 Intake Questionnaires 


Day 1 and Day 2 Intake Questionnaires -- Questions 1 to 6 
e The box instructing the interviewer to ask the water questions was removed. 


° Box 1 was added after Question 3, reminding the interviewer to transfer the Quick List 
foods to the grid and to check off the box next to the food item as it was transferred. 


° Question 6 was added, to determine whether the next Quick List food item had been 
consumed at the same time as the previously reported food. 


e The food REVIEW was moved from the end of the food intake questions to after 
Question 6. This change allowed the interviewer to review the intake after the 
description and quantity had been reported for each food rather than after the SP reported 
where the foods were obtained and eaten. 


° The REVIEW was scripted for each eating occasion and period between eating occasions 
to ensure that the interviewer reviewed the day's intake in a standardized manner. 


° Food source codes were added to Question 7. Additional codes included "bar, tavern, 
lounge," "vending machine," "meals on wheels," and "mail order." The food source 
codes "someone else" and "gift" were collapsed into one code. 


woo 


Day 1 Intake Questionnaire -- Questions 7 to 43 and Interviewer Observation Form 


° Questions 14 to 16, which asked about usual intake, were moved to Questions 11 to 13 so 
that they followed the food intake questions. 


a Question 33, which asks about blood cholesterol testing, was moved ahead of the height 
and weight questions. 


° The alcohol question (Q40) was divided into two separate questions, one about 
consumption and the other about type of alcohol consumed. 


® An Interviewer's Observation Form was added to the end of the questionnaire. 
° A question added to the Interviewer Observation Form asks the interviewer to determine 


whether other people present at the time of interview could have heard the SP's answer to 
the cigarette and alcohol questions. 


Day 2 Intake Questionnaire -- Questions 7 to 17 and Interviewer Observation Form 


Foods were added to the food list (Q17) and the list was reordered. 


3.C Summary of Revisions to the Food 


Instruction Booklet 


Attachment 3.C 
Summary of Revisions to the Food Instruction Booklet (FIB) 
January 1994 
Interviewer recording instructions were standardized. 
Icons were added for Additions, Sandwiches, Recipes, Salt, and Fat as a visual cue that 
the interviewer could find more specific recording guidelines in the instructions section of 
the FIB. 


All Q4 and Q5 probes were formatted as questions. 


Hanger names (i.e., KIND, TYPE, BRAND, FAT, SALT) and order within 
subcategories were standardized. 


All probes attached to hangers were standardized. 


Examples were added in column Q5 in categories where thickness sticks should be used 
to collect dimensions. 


Fast-food restaurants included in Survey Net were listed in the FIB fast-food subcategory. 
Pictures of poultry parts were added to the poultry subcategory to clarify chicken parts. 
Wedge and cylinder shapes were added to the pie, cake, and sausage subcategories as 
reminders of how to quantify foods. 

July 1994 


Table of Contents. New sandwich categories were added to the SANDWICH, 
SALADS, SOUPS category. 


Cookies, Brownies. In Q5, after the hanger IF STANDARD COMMERCIAL 
COOKIES, the probe was changed to “How many and what size?” The sizes “bite-size” 
and “regular” were added in parentheses to indicate the two possible choices. 


Cakes, Cupcakes, Snack Cakes. The probe after the hanger FORM was reworded and 
the “if” probes were resequenced for clarity. In column Q5, the word layers was 
underlined as a reminder to record the number of layers. 


Poultry. An “if” probe about poultry wings was added under the hanger IF PART, and a 
picture of a wing was included. 


Macaroni and Cheese. The subhanger Other Ingredients was added under IF HOME 
RECIPE to capture any ingredients not listed. In column Q5, an example was added 
after the probe “How much pasta and sauce mixed together?” 


Sandwich, Salads, Soups. This major category was expanded to include four new 
sandwich categories. 


Fast-Food Sandwiches, Fast-Food Breakfast Sandwiches. The first two hangers 
were rearranged to show more clearly whether the reported sandwich came from a 
fast-food restaurant. 


Hamburger on Bun. The hanger SPREAD was moved up after the hanger 
BREAD and more details were added to the “if” probes under OTHER 
INGREDIENTS. The BREAD probes were modified so that they would be the 
same as those used in the other sandwich categories. 


Hot Dogs. The hangers MEAT and BREAD were switched so that, when probing 
for a corn dog, the interviewer would not have to ask the bread probes. More 
details were included for Bread amount and Cheese amount. 


Grilled Cheese Sandwich. More details were added in the BREAD, CHEESE, 
and OTHER INGREDIENTS hangers to clarify the probes and make them similar 
to those used in the other sandwich categories. 


Peanut Butter Sandwich. Two “if” probes were added under OTHER 
INGREDIENTS to collect information about margarine/butter and mayonnaise. 

An ADDITIONS hanger was included to capture other foods added to the prepared 

sandwich at the table (e.g., banana slices or apple wedges). The BREAD probes 

were modified so that they would be the same as those used in the other sandwich 

categories. 


Other Sandwiches. This category was divided into four new categories: Bacon, 
Sausage, BLT Sandwiches; Beef, Ham, Pork, Chicken, Turkey, Vegetarian, Other 
Sandwiches; Egg, Egg Salad Sandwiches; and Fish, Shellfish Sandwiches. The 
BREAD, SPREAD, and OTHER INGREDIENTS hangers were standardized 
throughout the sandwich categories to reduce variability. 


Green Salads and Other Salads. The probes after the hanger SALAD DRESSING were 
modified so that they would be the same as those used in the sandwich categories. In Q5 


of the Other Salads category, the two hangers were deleted and replaced with the hanger 
IF VOLUME. 


3.D Supervisor/Senior Interviewer Training 


Agenda 
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3.E Interviewer Training Agenda 
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‘WHAT WE EAT IN AMERICA: 1994-1996 
INTERVIEWER TRAINING AGENDA 


PRE-TRAINING 


General Interviewing Techniques (4 hours in morning) - Community Session - Any interviewer new 
to Westat will be required to go through this session. Although conducted in community, 
trainees will not be in the community to which they will be assigned. 


Introduction to the LTEs and the Basic Keys used for the FMS (3 hours in afternoon or early 
evening) - Community Session - This presentation will start at staggered times throughout the 
day and early evening to accommodate various flight arrivals. Although conducted in 
community, trainees will not necessarily be in the community to which they will be assigned. 


Registration - Trainees will be assigned to training communities. Home Studies will be collected and 
trainees will receive per diem. 


#1: Introduction to What We Eat in America (7:15-8:00) - Plenary Session - Introduction and 
welcome from HNIS and Westat staff including basic explanation of study. 


DAY 1 


#2: Introduction to Training (8:30-8:45) - Community Session - Introduction to training staff and 
trainees in the community. Brief overview of the week's agenda. 


#3: Receiving Assignments and Beginning the Interview (8:45-10:15) - Community Session - 
Overview of materials, listing process, and sample design. Also includes introduction at the 
door, answering questions, and using publicity materials. 


BREAK (10:15-10:30) 


#4: Overview of the Interviewing Process (10:15-11:00) - Community Session - Introduction to 
the different questionnaires which will be used. Discussion of the basic contacting rules and 
timings for conducting the various types of questionnaires. 


#5: Introduction to the Household Folder and Administering the Screener (11:00-12:00) - 
Community Session - Using the Household Folder including description of sections, recording 
Screener results and recording SP identifying information. Conducting the Screener including 
identifying the respondent, rules for determining household members, and SP selection. 


LUNCH (12:00-1:00) 


#5: Introduction to the Household Folder and Administering the Screener (1:00-1:45) - 
Community Session - Continuation of above presentation. 


#6: Quality Control of Listing (1:45-2:45) - Community Session - Discussion of the missed 
Structure and missed DU procedure including documentation. 


BREAK (2:45-3:00) 


#7: Demonstration of the Individual Intake Questionnaire (3:00-4:00) - Community Session - 
Overview of the process for conducting the intake. 


#8: Introduction to the Day 1 Intake, FIB and Measuring Guides (4:00-5:30) - Community 


Session - Introduction to all necessary materials, introduction to the respondent and the flow of 
the intake including the Quick List. 


DAY 2 


#9: Day 1 Intake Scripts (8:30-10:15) - Community Session - A variety of scripts using the Day 1 
Intake. These scripts will build in complexity and focus on bringing out various specifications 
(such as recording combinations, etc.). 

BREAK (10:15-10:30) 

#9: Day 1 Intake Scripts (10:30-12:00) - Community Session - Continuation of above session. 

LUNCH (12:00-1:00) 

#9: Day 1 Intake Scripts (1:00-2:45) - Community Session - Continuation of above session. 

BREAK (2:45-3:00) 


#9: Day 1 Intake Scripts (3:00-5:30) - Community Session - Continuation of above session. 


DAY 3 


#10: Day 1 Intake Script and Missing Meal Data Retrieval (8:30-10:00) - Community Session - 
Script focusing on retrieval including a 30 minute session for missing meal data retrieval. 


BREAK (10:00-10:15) 


#11: Role Plays (10:15-12:00) - Dyads - Trainees will complete two role plays of the Day 1 Intake. 
One of these will be scripted and the other will be a "real" interview of their dyad partner. 
Trainees will be required to edit these questionnaires and turn them in at the end of the day. 


LUNCH (12:00-1:00) 


#12: Overview of Paid Respondent Practice (1:00-1:15) - Community Session - Description of 
process for the afternoon including grouping trainees. 


#13: Paid Respondent Practice (1:15-3:15) - Groups of 4 trainees Working in groups of 4, trainees 
will interview paid respondents using the Day 1 Intake Questionnaire. This session will include 
a variety of respondents (i.e., different ages, etc.) to expose the trainees to a wide range of 


problems. Trainees will be required to edit these questionnaires and turn them in at the end of 
the day. 


BREAK (3:15-3:30) 


#13: Paid Respondent Practice (3:30-5:30) - Groups of 4 trainees - Continuation of above session. 


DAY 4 


#14: Answers to Questions from Previous Day (including comments from HNIS' observation) 
(8:30-8:45) - Community Session 


#15: Recording Contact Attempts (8:45-10:15) - Community Session - Overview of the process of 
entering results into the FMS including discussion of the result codes and practice making 
simple entries. As an exercise, trainees will be required to enter the status of each role play and 
paid respondent interview from the previous day. 


BREAK (10:15-10:30) 

#16: Day 2 Intake Scripts (10:30-12:00) - Community Session - Script using the Day 2 Intake. 

LUNCH (12:00-1:00) 

#17; Wrap Up Exercise for the Intake (1:00-2:45) - Community Session - Exercise to pull together 
all of the concepts and specifications relating to the Intake and related materials. This session 
includes time for the trainees to complete the exercise and time to review it. 


BREAK (2:45-3:00) 


#18: The Household Questionnaire (3:00-4:30) - Community Session - Conducting the Household 
Questionnaire including identifying the respondent. 


#19: Editing the Individual Intake (4:30-5:30) - Community Session - Exercise to practice 
recognizing problems with the intake. 


DAY 5 


#20: Administering the Screener - Part 2 (8:30-10:15) - Community Session - Discussion of the 
more complex procedures and specifications for the Screener including the use of neighbor 
information. Introduction to different types (result codes) of completed Screeners. 


BREAK (10:15-10:30) 


#21: The Household Questionnaire - Part 2 (10:30-12:00) - Community Session - Scheduling 
considerations for conducting the Household Questionnaire, answering respondent questions and 
specifications for the questionnaire. 


LUNCH (12:00-1:00) 


#22: Administering the DHKS (1:00-2:15) - Community Session - Selecting the respondent and 
Scheduling the interview, answering respondent questions, telephone procedures, and 
specifications for the questionnaire. 


#23: Putting It All Together (2:15-2:45) - Neighborhood Session - Practice doing interview in 
simulated real life setting. Working in small groups, trainees will go in front of the room to 
play role of interviewer (using all materials such as measuring guides, etc.). 


BREAK (2:45-3:00) 


#23: Putting It All Together (3:00-5:30) - Neighborhood Session - Continuation of above 
presentation. 


DAY 6 


#23: Putting It All Together (8:30-9:30) - Neighborhood Session - Continuation of above 
presentation. 


#24: Recording Contact Attempts, Contact Problems and Procedures, Avoiding Refusals (9:30- 
10:15) - Community Session - A variety of exercises focusing on contact problems and 
procedures using the Household Folder and FMS. These exercises will build in complexity and 
focus on bringing out various procedures (both documentation of situation and handling the 
respondent). Will also include backup procedures and using Email. 


BREAK (10:15-10:30) 


#24: Recording Contact Attempts, Contact Problems and Procedures, Avoiding Refusals (10:30- 
12:00) - Community Session - Continuation of above presentation. 


LUNCH (12:00-1:00) 


#24: Recording Contact Attempts, Contact Problems and Procedures, Avoiding Refusals (1:00- 
2:45) - Community Session - Continuation of above presentation. 


BREAK (2:45-3:00) 


#25: Transmitting FMS Data to Your Supervisor and Role Plays (3:00-5:30) - Dyads - During 
Role Plays, trainees will be pulled to learn procedures for transmitting data including a practice 
where each trainee will transmit. When not in this session, trainees will complete a scripted 
Role Play which will include each questionnaire type. Trainees will be required to edit these 
questionnaires and turn them in at the end of the day. 


DAY 7 


#24: Recording Contact Attempts, Contact Problems and Procedures, Avoiding Refusals (8:30- 
10:15) - Community Session - Continuation of presentation from previous day. 


BREAK (10:15-10:30) 


#26: Market Checks (10:30-10:45) - Community Session - Discussion of procedures for conducting 
a market check and completing the form. 


#27: Data Uses (10:45-11:15) - Plenary - HNIS presentation to further explain use of the data (using 
factbook as reference). 


#28: Final Review of the Questionnaire - Review of Paid Respondent and Role Play Experiences 
(11:15-12:30) - Plenary - Answer questions that still need clarification and review experience 
from paid respondent and role play interviews day. Answer any outstanding questions from the 
floor. [Trainees will receive individual feedback from the Review 2 forms. The information 
from this session along with the early editing will be the basis for the first newsletter. ] 


LUNCH (12:30-1:30) 


#29; Quality Control and Administrative Procedures (1:30-3:00) - Community Session - 
Discussion of all procedures including receiving feedback from the supervisors on data quality 
(using previous presentation material as an example). 


BREAK (3:00-3:15) 
#30: Explanation of Practice Interviews, Meeting with the Supervisor and Packing Up the LTEs 


(3:15-4:30) - Community Session - Description of procedures for completing the practice 
interviews and of the process for evaluating them. 
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Attachment 3.F 
Periodic Quizzes Administered to the Interviewers 


During the CSFII/DHKS 1994, the supervisors administered five quizzes to their 
interviewers over the telephone. The text of the quizzes is provided in the following pages. Except 


for the August 1 quiz, all quizzes were sent by the field director to the supervisors via Email. 
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From: Field Director 5/11/94 
To: Supervisors and Interviewers 
Subject: Intake Review Exercise Memo 221 


women nnn nnn nnn nn nnn nnn nn nnn nnn nnn nnn nnn nnn nnn nnn Message Contents ------------------------------------------------- 


Throughout the second quarter, we will conduct a series of refresher training exercises. The 
first one addresses the proper way to administer the review of the Intake. We've listened to 
the Intake tape recordings and noticed that the review still gives some interviewers a bit of 
trouble. 


Please copy the following information onto a piece of paper. During your next report call with 
your supervisor, she will ask you to refer to the review question on your laminated card or in a 
blank Intake questionnaire. Using the times, occasions, and food items below, your supervisor 
will ask you to review the day's intake. 


TIME OCCASION FOOD ITEM 
6:00 am 01 coffee 
corn flakes 
toast 


9:30 am 06 donut 
coffee 


6:45 pm 04 wine 
steak 
potato 


apple pie 


3:00 pm 06 coffee 
cream 
sugar 


12:30 pm 03 hot dog 
baked beans 
milk 
olives 


9:00 pm 06 apple pie 
coffee 
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From: Field Director 5/11/94 4:42 PM 
To: Supervisors } 
Subject: Intake Review Exercise Memo 221 Part B 


Rn nn nnn Message Contents ------------------------------------------------- 
During this week's report calls, please conduct the exercise described in Memo 221 with all of 
your interviewers. If an interviewer did not receive the Email for some reason, please read the 
time, occasion, and food list to him/her. If you feel that this will not give the interviewer 


enough time to prepare for the exercise, schedule an appointment to call the interviewer back. 


The review continues to give interviewers problems, as you have certainly noticed when 
listening to the tapes. 


Interviewers who demonstrate a lack of proficiency in administering the review should be 
considered candidates for additional retraining by you or your senior interviewer. 


During our call on Monday, we'll discuss the exercise and how well it served our purpose. 
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From: Field Director 6/15/94 11:30 AM 


To: 


Supervisors 


Subject: Memo #249 DHKS Exercise 


won nnn nn nnn nnn nnn nnn nnn nnn nnn nnn Message Contents ------------------------------------------------- 


I would like you to conduct the following mini-mock exercise with your interviewers 
during report calls this week. 


EXERCISE ON QUESTIONS 5 & 6 IN THE DHKS: What have you heard about 
health problems caused by......... ? 


Directions to interviewer: Please turn to page 5 in a blank DHKS questionnaire and ask 
me this series of questions. Record your answers on a piece of paper. Do not record in 
the questionnaire. You should start with item "c." 


ITEM Q5 Q6 
No 
d. Yes Dental problems (07) WAIT FOR PROBE 
Rickets (03) WAIT FOR PROBE no 
ei Yes makes you fat (15) WAIT FOR PROBE no 
i Yes rots your teeth (07) WAIT FOR PROBE 


gives you the shakes (00) SHOULD RECORD 
VERBATIM WAIT FOR PROBE no 


g No 
Yes some health problems, I can't recall now (17) 
b. Yes trouble using the toilet (00) SHOULD 


RECORD VERBATIM WAIT FOR PROBE no 


After the role play, have the interviewer read you his/her entries. "Gives you the 
shakes" and "trouble using the toilet" are too vague to be coded and must be recorded 
verbatim. 


Evaluate the interviewer on the following items: 


1. Following the random start. Did he/she return to the top and ask a. and b.? 
2. Did he/she probe after each condition until you answered "no"? 


3. Did he/she select the correct codes for health conditions with codes? 
Refer the interviewer to the QxQs, page 15-15 in the Interviewer Manual if necessary. 


We will chat on Monday during our report call about this exercise. 
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WESTAT 


An Employee-Owned Research Corporation 


MEMORANDUM 

TO: What We Eat in America Supervisors August 1, 1994 
Memo #271 

FROM: Susie McNutt 


SUBJECT: FIB Sandwich Pop Quiz 


_ a 


Attached is a list of questions to ask each interviewer during Thursday's reports. 


The three main questions are within the Shaded boxes. Read the questions exactly as written. 
The answers are listed in caps and parentheses after each question. 


In the first question you will be asking the interviewers to identify the appropriate sandwich 
Category from which to probe for specific sandwiches that are listed below the box. 


In the second question you will be asking a series of subquestions about a roast beef sandwich. 


s The second and third Subquestions refer to an important change in the sandwich category. 
Instead of referring the interviewer back to the MEAT, POULTRY, FISH category for 


probes about roast beef sliced from a roast, the probes have been incorporated into this 
category. 


. The last subquestion refers to cheese and will reinforce to the interviewers that an 
additional probe has been added for cheese amount when cheese is not presliced. 


The third question involves role playing. The correct probes for the fried clam sandwich are 
listed below the question. 
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INTERVIEWER'S 
SANDWICH EXERCISE 


WICH CATEGORY WOULD YOU PROBE FROM IF A. 


WHICH SAND 
eee RESPONDENT REPORTED EATING A: 


° Sausage biscuit? 
(BACON, SAUSAGE, BLT SANDWICHES, PAGES 56A-56B) 
° Hamburger from A & W? 
(HAMBURGER ON BUN, PAGES 61A-61B) 
° Meatloaf sandwich? 
(BEEF, HAM, PORK, CHICKEN, TURKEY, VEGETARIAN, OTHER SANDWICHES, PAGES 
57A-57B) 
e Egg McMuffin? 
(FAST FOOD SANDWICHES, PAGE 55) 
e Tuna fish sandwich? 
(FISH, SHELLFISH SANDWICHES, PAGES 59A-59B) 
° Fried egg sandwich? 
(EGG, EGG SALAD SANDWICH, PAGES 58A-58B) 
® Veggie Sandwich? 
(BEEF, HAM, PORK, CHICKEN, TURKEY, VEGETARIAN, OTHER SANDWICHES, PAGES 
S7A-57B) 


| IF A RESPONDENT REPORTED EATING A ROAST BEEF SANDWICH AND | 
DESCRIBED THE MEAT AS BEING SLICED FROM A RIB ROAST, 


e which category would you probe from? 
(BEEF, HAM, PORK, ETC....., PAGES 57A-57B) 

e which meat probes would you use? 
(GO TO THE HANGER “IF OTHER FORM" AND ASK THE PROBES AFTER THE 
SUBHANGER "IF BEEF/HAM/PORK”) 

° what information would you need to record the amount of meat on the sandwich? 
(SHAPE, DIMENSIONS OR WO (RAW OR COOKED)) 

e if he also reported putting a "chunk" of cheese on the sandwich, what information 
would you need to record the quantity of cheese? 
(FIRST VERIFY NOT PRE SLICED; THEN ASK SHAPE AND DIMENSIONS (LENGTH, 
WIDTH, THICKNESS STICKS) ) 


NOW GET OUT’A PIECE OF PAPER. I AM THE RESPONDENT, AND I ATE: 
_A FRIED-CEAM SANDWICH FOR LUNCH AT 2:00PM YESTERDAY. ASK: 
ME ake ERNE AND RECORD THE RESPONSES AS YOU WOULD ON’ A 3 


BREAD: bun 
Grain: sour dough 
Type: commercial, regular 
Bread amount: one medium bun 


SPREAD: yes, mayonnaise 
If mayonnaise — 
type: DK real, DK regular, DK brand 
Spread amount: 2 tablespoons 


FORM: something else 
Type: fresh 
Preparation: fried 
Coating: battered 
Salt: DK 
Fat: yes, DK kind 
Brand: restaurant, The ClamDigger's Paradise 
Other amount: 1/2 cup clams 


OTHER INGREDIENTS: Yes, coleslaw 
If something else: about 1/4 cup 


ADDITIONS: sliced dill Pickles 


QS: ate all 


Pickles: (page 36)° dill, regular, 2 round medium slices 


From: Field Director 9/9/94 9:53 AM 


To: 


Supervisors 


Subject: HHQ Income Exercise Memo #294 


won nnn anna nnn nnn nnn nnn nnn nn nnn nnn nnn nnn Message Contents ------------------------------------------------- 


HOUSEHOLD QUESTIONNAIRE INCOME SECTION EXERCISE 


The September exercise in our What We Eat in America Continuing Education program 
consists of a mini-mock on the income section of the Household Questionnaire. This section 
can be troublesome for both interviewers and respondents since the unit of time changes from 
yearly income to monthly income halfway through the section. 


Please administer the following exercise to your interviewers during report calls the week of 
September 11. Before the call, send them an Email instructing them to have note paper, a 
pencil, the hand cards, and a blank HHQ available. 


Score the exercise using Excellent, Good, Fair, and Poor. Provide me with the scores after the 
calls. Remember, senior interviewers should also do the exercise. You will act as the 
respondent. DO NOT INTERRUPT THE INTERVIEWER DURING THE MOCK. IF THE 
INTERVIEWER TAKES THE WRONG SKIP, STAY WITH THE FLOW. IF THE 
INTERVIEWER DOESN'T PROBE FOR A CORRECT RESPONSE, SAY NOTHING 
ABOUT IT UNTIL THE EXERCISE CRITIQUE. 


INSTRUCTIONS TO THE INTERVIEWER - Today's exercise covers the HHQ's income 
section. Please write down the Screener information. 


John age 40 reference person 

Mary age 39 wife and HHQ respondent 
Tim age 25 son 

Joe age 24 roomer 


The Check Screener Box on the questionnaire cover is coded NO. 

Please turn to page 13 and start at Box 5. Read from the HHQ but record your answers on 
note paper. You do not have to read the hand cards to me, just tell me the number of the card 
that you are handing to me. 

BEGIN 

Card selected should be $3-04 ANSWER IS_ More 


48. Yes. My son has a paper route. 


49. He made $3,000 after paying for gasoline. 


0) amy Cae 
51. $500 not counting Joe. I don't know much about his finances. 


52. $45,000. Joe's a mailman, should I estimate his salary? ANSWER IS YES. That's 
about $25,000 more. Should J add that to mine? ANSWER IS YES $70,000. 


S32, OK IPs 

54. No. 

55. HAND CARD H-7 Letter C - Again that's without Joe. 

56a. HAND CARD H-8 Yes. 

57a. I told you $70,000. THIS ANSWER IS INCORRECT. INTERVIEWER SHOULD 


PROBE FOR MONTHLY INCOME. $70,000 IS A YEARLY FIGURE. IF 
INTERVIEWER PROBES CORRECTLY, ANSWER SHOULD BE About $6,000, I 


guess. 


57b. through e. ARE ALL ANSWERED No. 


S6f. Yes, my husband gets a check from his father's estate. It's $1,200 a year. ANSWER 
SHOULD BE MONTHLY, NEED PROBE HERE $100. 


Box 6 No. 
58. SKIP. 
SU eeNO: 
60. No. 


INSTRUCTION TO SUPERVISOR: At the conclusion of the exercise, ask the interviewer to 
read his/her answers to you. Base your evaluation on the following points. 


51. Marginal note should read "Excluding Joe" or something similar. 

52. Should be $70,000. Marginal note may or may not have figures added together. 
55. Marginal note should read "Excluding Joe" etc. 

57a. Confirm that monthly figure is entered, not yearly. $6,000 


S7f. Confirm that monthly figure is entered, not yearly. $100 


From: Field Director 10/4/94 10:23 AM 
To: Supervisors and Interviewers 
Subject: Memo #309 Sampling Exercise for This Week's Report Call 


wont nnn nnn nnn nn nn nnn nnn nnn nnn nnn nnn nnn nnn nnn Message Contents  ------------------------------------------------- 


Your Quarter Four assignments are packed up and ready for shipment. You can mail your 
advance letters no sooner than Friday, October 7, and begin screening no sooner than 
Thursday, October 13. 


This month's report call exercise focuses on screening and SP selection. Please take a blank 
Screener from your bulk supplies and prepare it for the exercise by writing in the sampling 
information for a Message 15. 


Box 1 

Males 12-49 Yes (ie) P2Noo, (ii) 

Females 12-19 Yes (HO Nom ( SS) 
40-49 Yes (ome Nog. Ce) 

Box 3 

Males 1-11 Yes (ee )aeNowe te) 
50+ ES Tan(ewh) weNod POE t) 

Females 1-11 Yes (5) sRNO Gs (o *) 
50+ Yes (am) ENo = ( ) 


Have your prepared Screener and your hand cards available for the exercise. 
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From: Field Director 10/4/94 10:50 AM 


To: 


Supervisors 


Subject: Memo #309 Part Two Answer Key 


won nnn nnn nnn nnn nnn nn nnn nnn nnn nnn nena nn Message Contents ------------------------------------------------- 


Here is the enumeration for the screening/SP selection exercise for this week's report calls. 
Number of household members 6 

Date of Screening Oct 6 Starting and ending times actual 

a. Dan, black, none of above, Feb 3 1910, age 84, male 

b. Louise, wife, black, none of above, Dec 13 1912, 81, female 

Ce Joe, son-in-law, white Mexican, Sep 18 1950, 44, male 

d. Jane, daughter, black, none of above, Nov 9 1954, 39, female 

e. Bill, grandson, black, none of above, Apr 8 1987, 7, male 

f. Betty, granddaughter, black, none of above, May 2 1994, 5 months, female 

Louise is Screener respondent. 


At this point in the exercise, allow the interviewer to put the phone down while he/she works 
through the sampling page, Box 1. 


Box 1 should have a YES next to Male 12-49. 


Question 14 should be asked with card 6. Ask the interviewer to tell you the amount on the 
card - $25,690. 


Question 14 is answered LESS. 


At this point in the exercise, allow the interviewer to put the phone down while he/she works 
through the sampling page, Box 3, and the rest of the page. 


Box 3 should have a YES next to Male 1-11, Male 50+, Female 50+. 


Since there are SPs, the baby should be taken. 


The SPs are: 


Dan SPO1 
Louise SP02 
Joe SP03 
Bill SPO4 
Betty SP05 


Give the interviewer a phone number and tell him/her you are not moving and that no missed 
DU is required. 


At the conclusion of the exercise, have the interviewer tell you what he/she recorded on the 
cover, enumeration grid, and sampling page. 


Please grade the exercise on the following points: 


1. 


a, 


4. 


oF 


Were all questions asked as written? 
Did the interviewer calculate ages correctly? 


Did the interviewer record the Screener respondent, times, and disposition code on the 
cover? 


Did the interviewer select the correct income card? 


Did the interviewer select the correct SPs? 


Grade Excellent - perfect 


Very Good - very minor error that would not change sampling 
Good - error that would not change sampling but would lose data 
Fair - fumbled around, selected all SPs 

Poor - missed at least one SP 


Report grades and comments to me on Email after all persons in your region have completed 
the exercise. 
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WHAT WE EAT IN AMERICA: 1994-1996 
CONTINUING SURVEY OF FOOD INTAKES BY INDIVIDUALS 


TAPE RECORDED INTERVIEW EVALUATION FORM 


Affix mini-label or record Household ID: 


Interviewer Name: Interviewer ID: 


Supervisor: 


Evaluator: 


Date: / 


Type of Questionnaires Observed: 
[_] Household Questionnaire 
[_] Day 1 Intake + Number Evaluated: 
[_] Day 2 Intake > Number Evaluated: 


[] Diet and Health Knowledge Survey Questionnaire 
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A. BEGINNING THE INTERVIEW 


Characterize the interviewer's interaction with the respondent at the beginning of the interview. 


Unprofessional 1 2 3 4 5 Professional 
Unprepared 1 2 3 4 5 Prepared 
Unorganized 1 2 3 4 5 Organized 
Unfriendly 1 2 3 4 5 Friendly 


Did the interviewer follow the correct procedures for securing the respondent’s permission to 
tape the interview? 


IF NO, EXPLAIN: 


B1. 


B2. 


B3. 


B4. 


B. HOUSEHOLD QUESTIONNAIRE 


[| IF NO HOUSEHOLD QUESTIONNAIRE EVALUATED, CHECK HERE AND GO TO SECTION C. 


Did the interviewer make a smooth transition to the Household Questionnaire? 


IF NO, EXPLAIN: 


Did the interviewer select the respondent by asking to speak to the person with the most 
knowledge of food preparation and purchasing for the household? 


VES Sec Pre cashes ee ane eee 1 
NO 2 sii thas ntie da etlesicans aoe eee 2 
R ALREADY KNOWN \c.2.3201..csneeeeee 3 


IF NO, EXPLAIN: 


ssn saree 


There are a number of places throughout the Household Questionnaire where the interviewer 
needs to transfer information from the Screener (e.g., Occupation questions, school lunch 
questions, child care questions, etc.). 


Did the interviewer refer to the Screener and correctly transfer the information? 


NA err eee PR nen ook Ante eo 1 
lO Ferrara ele ind ine wernt. Boo 2 
CANT TELLS serene crete eee 8 


IF NO, EXPLAIN: 


———— LL 


Did the interviewer use the hand cards presenting them to the respondent, and taking the cards 
back after the question was answered? 


YES Se cerstes eels eens hte ea ee 1 
i 18 feresee oerrmtaparentiiese eer eit 0 oe we 2 
CANT TELL ee ee 8 


IF NO, EXPLAIN: 


Bo 


B6. 


B7. 


B8. 


Bg. 


B10. 


Sit, 


Did the interviewer select the correct income card at Q47? 


SE oho 1 
NODAL EIEN chee nt at Sod arled cect er 2 
OS 7TNOMASKED Seasreyisten 5 en, 3 
SAN ia El eet ee eee te 8 


IF NO, EXPLAIN: 


Did the interviewer follow the correct income questions skip patterns? 


IF NO, EXPLAIN: 


Did the interviewer read the income questions in a calm, nonthreatening way? 


If the respondent refused to answer any or all of the income questions, did the interviewer accept 
the refusal in a pleasant professional manner? 


A SbToaLivix 5.» eatedins Manet coal okt en ee 1 
NI@ Rice Ay,» re reali ete tee et ce 2 
SOME Te AU EST BRS a F258 Galen ere Ae 3 


IF NO, EXPLAIN: 


ADDITIONAL COMMENTS ON THE HOUSEHOLD QUESTIONNAIRE. 


—_—_—————————————————————————— eee 


OVERALL EVALUATION OF THE HOUSEHOLD QUESTIONNAIRE INTERVIEW. 


Unacceptable 1 2 3 4 5 Excellent 


Ci. 


G2: 


C3. 


C. DAY 1 OR DAY 2 INTAKE 


[_] IF NO INTAKE QUESTIONNAIRE EVALUATED, CHECK HERE AND GO TO SECTION D. 


Did the interviewer make a smooth transition to the Intake? 


IF NO, EXPLAIN: 


Did the interviewer select an appropriate proxy respondent? 


NEG enctoicencrcer cut ee cine eee 1 
NOR cveniaree uo ee 2 
BBO NOLNECOE DI. sees 3 


IF NO, EXPLAIN: 


Did the interviewer use the Intake timeline to demonstrate what day of the week and hours of the 
day constituted the Intake day? 


RASS PU. 1» Sem eAae Henk wee Rat ne 1 
ST ee. ae nemener ECR PEA EN ere 2 
NODTINECESSAR Vier. ors. eee? ..... 3 


IF NO, EXPLAIN: 


Did the interviewer allow the respondent to recall food items for the Quick List without 
interruption? 


IF NO, EXPLAIN: 


C5. 


C7. 


C8. 


C9. 


Did the interviewer ask the Intake questions in the proper sequence? 


IF NO, EXPLAIN: 


ee 


Throughout the Intake Questionnaire, the interviewer has to use a variety of materials. 
Considering the hand cards, FIB and measuring aids, did the interviewer properly use the 
materials in a organized, effective manner? 


Nd SS hassel, «eee eee 1 
DS scorn tee i A RAL ET 2 
SENNA ST EU ee ae caso nesvretor arch ciao 8 


IF NO, EXPLAIN: 


ee 


Did the interviewer always refer to the FIB for probes? 


IF NO, EXPLAIN: 


Please rate the interviewer's skill in using the FIB. 


ECE CEN [ee eee earn aa 1 
ELD, 8B) esa sa 5 Freer ste A RRA RR 2 
al Rb ieee ple eee ata eo ARS 3 
LOL he 28 eae eee Ne OUT ee 4 


IF NO, EXPLAIN: 


C10. 


C11. 


C12. 


Did the interviewer appropriately answer any questions the respondent had? 


IF NO, EXPLAIN: 


ADDITIONAL COMMENTS ON THE INTAKE QUESTIONNAIRE. 


Sc 


 _—_—_—_—_—_—_——— 
eee 
_———_—_———————— 
eS 


OVERALL EVALUATION OF THE INTAKE QUESTIONNAIRE INTERVIEW. 


Unacceptable 1 2 3 4 iS Excellent 


D1. 


D2. 


D3. 


D4. 


DS. 


D. DIET AND HEALTH KNOWLEDGE SURVEY QUESTIONNAIRE 


[_] IF NO DHKS QUESTIONNAIRE EVALUATED, CHECK HERE AND GO TO SECTION E. 


Did the interviewer conduct the DHKS in person or by telephone? 


IF NO, EXPLAIN: 


IF NO, EXPLAIN: 


IF NO, EXPLAIN: 


IN:;PERSON) SMe Sra ea As 1 

TAOS ea ONS. geen tee eee eee ee 2 (D4) 
Was it appropriate for the interview to be conducted in person? 

\ dabei Ee, AEN eee ee 1 

Nek G. one ee 2 } Pe 
Did the interviewer have an acceptable telephone technique? 

NALS), custee eed pecan ae 1 

ING erp ere eee ote naa cci chy dacs usedeeervan 2 
Did the interviewer appropriately answer any questions the respondent had? 

DLE acres or recat eeprerer coroner hrertenrer epreaee tern 1 

DO leo one tie Mit Ate they Pee 2 
Did the interviewer ask the random start questions in a random pattern? 

AS peciscre reraerpe TE 1 

UN 9 nc cere bn Re rr ee Me ee 2 


IF NO, EXPLAIN: 


D6. 


Bye 


ADDITIONAL COMMENTS ON THE DHKS QUESTIONNAIRE. 


OVERALL EVALUATION OF THE DHKS QUESTIONNAIRE INTERVIEW. 


Unacceptable 1 2 3 4 5 Excellent 


E1. 


E2. 


E3. 


E. OBSERVATIONS TO BE RECORDED AFTER THE INTERVIEW 


How well did the interviewer: 


a. Handle the respondent’s questions? 
Rambling 1 2 3 4 s Clear 
Uninformative 1 2 3 4 5 Informative 


b. Maintain the flow and pace of the interview? 


Poorly 1 2 3 4 : Very well 
oR Read the questions as written? 
Poorly 1 2 3 4 5 Very well 


d. Probe (without leading)? 


Poorly 1 a 3 4 > Very well 


What are the interviewer's strong points? 


What areas, if any, need improvement? 


E4. 


Other comments: 


10 
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WESTAT 


An Employee-Owned Research Corporation 


MEMORANDUM 

TO: What We Eat in America Interviewer Aes February 4, 1994 
Memo #191 

FROM: Judy Meader, Field Director 


SUBJECT: Questions & Answers, Replacement page, Endorsement Letter 


Enclosed in this mailing are three items: 


1. Debbie Bitmer and Susie McNutt compiled a comprehensive memo answering questions that arose 
at and after training. Please read through the memo and file it in your Interviewer Manual. 


2. We discovered an error on page 5-37 of the Interviewer Manual. Remove page 5-37 from your 
Interviewer Manual and discard it. Insert the enclosed page. The correction appears in the second 
bullet, third line. 


3. Here is the study's first endorsement letter from the NEA. Insert it in your Fact Book in the Letter 
section. This letter will be helpful to you when you interview parents and school aged children OR 
persons involved in education. 


I hope you are enjoying your work on What We Eat in America and that Old Man Winter will soon 
leave us all alone! 
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Use of Neighbor Information with the Selected DU 


If a household member refuses to complete the Screener, you are to proceed as 
follows: 


s Accept the refusal gracefully. Attempt to complete the Neighbor 
Information Section of the Screener with the household member who is 
refusing. 


You should introduce your request as follows: 


"I understand that you are busy but I only have a few 
questions. It is very possible that if you provide this 
information, no further information is required from your 
household.” 


Proceed through Box 6, questions 20 and 21, as appropriate, and Box 8. 
If the answer is "no" to all, the Screener is considered an interim refusal 
until your supervisor authorizes you to code it an SOS (CODE SRF) with 
no eligible sample persons obtained by household information (not 
neighbor information, even though you used the Neighbor Information 
page). 


a If you receive a "yes" at Box 6, question 20 and/or 21, or Box 8, the 
screener would be considered an interim refusal until your supervisor 
authorizes you to code it an S02. 


In some cases, a guest or employee (e. g., a housekeeper or baby sitter) of the 
household will be the only respondent available to provide Screener data. If so, attempt to 
complete the Neighbor Information Section of the Screener as explained above. When 
completed, record name and relationship to household at the bottom of the page. 


NOTE: Since the information you are receiving is from the selected DU, it 
is not necesssary to confirm with a second source. 


Example #1: 


Suppose you are at a household and an older gentleman, appearing to live alone, 
answers the door. He seems very suspicious and refuses to answer the detailed questions 
conceming name, race, ethnic origin, etc. The sampling message is #01, which tells you to 
select all children ages 1-2 years. You have a hunch that this gentleman's household may be 
ineligible. So rather than accepting the refusal and attempting to contact 2 neighbors, you flip 
the Screener over in attempt to have the gentleman answer the Neighbor Information 
questions. 


You manage to have the gentleman tell you the sex and age of all household 
members. They are as enumerated below: 
Male 58 


1. In Box 6, you would indicate that there is one (1) male aged 50-59. The skip 
instructions indicate that Question 20 must be answered. 


SS 
NEIGHBOR INFORMATION 


St 


123-456-789-0 
6 


HOW MANY? 
50-59 pay Poste 


IF NUMBER, ANSWER 0.20 
IF 0, SKIP TO BOX 8 


Ps The answer to Question 20 is "NO", because there are no household members 
less than 6 years of age. The skip instructions indicate that you should not ask 
Question 21, nor go to Box 7, but skip directly to Box 8. 


20. ARE THERE ANY CHILDREN LESS THAN 6 YEARS OF AGE? 


21. IS THERE A MALE 18 YEARS OF AGE OR ? 


Ned 


NATIONAL EDUCATION ASSOCIATION 


Keith Geiger, President 1201 16th Street, N.W. 
Robert Chase. Vice President : Washington, D.C. 20036-3290 
Marilyn Monahan, Secretary-Treasurer (202) 822-7300 Fax (202) 822-7741 
Don Cameron, Executive Director GOVERNMENT RELATIONS 


Debra DeLee, Director 


January 3, 1994 


Dear Resident: 


The person presenting this letter is part of an important national nutrition survey called "What We 
Eat in America." You have been selected at random to participate in this study. I strongly 
encourage you to do so. 


The survey is being conducted by the U.S. Department of Agriculture to determine the dietary 
status of the population. Results will be used to improve nutrition education and food assistance 
programs and to monitor the safety of the food supply. 


The information you give as part of the survey will be kept confidential and used only along with 
information given by thousands of other individuals in statistical summaries. Your participation is 
voluntary. However, if you do not participate, no one else can take your place. Since you represent 
thousands of other people, valuable information will be lost. 


We at NEA fully support the efforts of the U.S. Department of Agriculture in its goal of providing 
valuable information on the dietary status of the nation's population. If you wish to receive 
additional information, the interviewer can provide you with a telephone number at which you can 
verify the survey. 


Sincerely, 
eee 
Phicka! UGE ~¢—_ 
Michael Edwards 


Manager, Federal Relations 
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What We Eat in America 
Interviewer Training Wrap-Up 


The attached questions and answers are provided to document the information Debbie and 
Susie presented on the last day of Interviewer Training. Please read and then put this memo into your 
Interviewer Manual. 


During the data collection effort we are sure you will encounter situations which you are 
not certain how to handle. In addition to providing you with as rapid an answer as possible, answers 
will be documented in a newsletter. In order to be sure that everyone receives the information they 
need, we will send out the Interviewer Newsletter at the beginning of each quarter. The newsletter 
will also include items from you - for example, project experiences and stories that are worthy of 
sharing. If you have any suggestions or ideas for columns, please send them to your supervisor with 
your T&E. Thanks! 


GENERAL PROCEDURES 


In what order should I conduct the 
questionnaires? 


The Screener is always first. If SPs are 
selected, you will then continue with the 
Household Questionnaire followed by 
Day 1 Intake Questionnaires. However, 
if the Household Questionnaire 
respondent is not available but an SP for 
a Day 1 Intake is available, it is 
permissible to complete Day 1 Intake(s) 
prior to completing the Household 
Questionnaire, as long as you are in the 
household on one of the Day 1 Intake 
contact days (on the label). It is also 
permissible if you think the household 
would be more cooperative if you 
conducted the intake (s) in advance of 
conducting the Household interview. 
Use your judgement. 


Is each of the incentives handed to the 
respondent prior to the beginning of the 
various questionnaires? 


No. The measuring cups and spoons 
should be handed to the first respondent 
after the Screener and at the beginning 
of the questionnaire (either the 
Household Questionnaire or Day 1 
Intake Questionnaire). The cups and 
spoons are a household level gift. The 
nylon sack should be handed to each SP 
at the beginning of the Day 1 Intake 
Questionnaire. The drinking mug 
should be handed to each SP at the end 
of the Day 2 Intake Questionnaire. Both 
the nylon sack and drinking mug are SP 
level gifts. 


In training we discussed giving the nylon 
sack to a child who is not an SP if that 
child was very upset about not getting 
one. May we follow this procedure for 
the drinking mug? 


Yes. Keep in mind that we have a 
limited supply of sacks and mugs and 
you should only give them to non-SPs if 
you think it is absolutely necessary. 


How old must a person be to serve as an 
interpreter? 


16 years of age or older. 


Although we do not ask for last name, is 
it okay for me to record it if the 
respondent provides it? 


We do not want the last name recorded 
on the case. There are two exceptions: 
1) you will ask the selected DHKS 
respondent to record his/her full name 
on the DHKS appointment reminder 
card; and 2) if data retrieval is required, 
you will ask for the SP's last name and 
record it above the Follow Up Call 
Record. Do not record last names on 
any other survey material that is sent to 
Westat. 


Is it okay to do interviews in locations 
other than the respondent's home? 


No. In order to conduct an interview in 
another location, you would have to 
make an appointment. Remember 
appointments are only allowed for 
certain questionnaires at certain points in 
the interviewing process. In addition, 
the respondent loses the ability to 
reference his/her own dishes and food 
items. 


On page 4-14, the manual tells us to 
visit the post office and request a change 
of address for someone who has moved. 
I read in the newspaper that the post 
office was discontinuing this practice. 
Which is correct? 


The post office has changed the 
procedure and will no longer honor a 
change of address. Therefore, we will 
need to send a letter to obtain the 
correction. If you have a case for which 
you want a change of address requested, 
please discuss it with your supervisor. 


On page 11-22, the T&E example 
includes portions of hours recorded both 
as decimals and fractions. Which one is 
correct? 


Actually you may use either decimals or 
fractions on the T&E. However, since 
the FMS uses decimals, we recommend 
you consistently use them. 


There are some areas in my community 
that could potentially be dangerous. 
What should I do? 


Discuss the situation with your 
supervisor. She may decide to approve 
the use of an escort. 


Will we be getting more information to 
provide to the respondents? 


As information from the study and about 
the study is available, we will send it to 
you so that you can add it to your 
Factbook. For example, as articles are 
published in newspapers, we will send 
you copies from the newspapers in your 
area. 


There are some local organizations 
whose endorsement might be useful in 
helping to convince people to cooperate 
in the study. Should I contact these 
organizations? 


No. Discuss your ideas with your 
supervisor. She will then work with the 
home office to come up with a plan for 
contact. In addition, do not grant 
interviews with any local organization or 
newspaper. If you are contacted, refer 
inquires to your supervisor and be sure 
to notify her to expect a call. 


SCREENER 


When reading the introduction, should I 
always show the gift of measuring cups 
and spoons? 


No. You should only show the gift if 
your respondent asks what it is. When 
showing it, be sure to mention that one 
set is given only to eligible households. 


What is the difference between Line 
Letters and Sample Person Numbers on 
the Enumeration Table? 


Each person who lives in the household 
is assigned a Line Letter. This letter 
will be used to identify household 
members throughout the Household 
Questionnaire. Only Sample Persons 
(SPs) are assigned a Sample Person 
Number. Once assigned, the SP 
Number becomes an extension of the 
Case ID and is used to identify the SP's 
questionnaires. For example, it is used 
on the cover of the Intake 
Questionnaires. It is very important that 
you use the line letters of household 
members (including SPs) when 
completing the household questionnaire 
and the SP number to identify documents 
associated with eligible household 
members. 


If a person qualifies as a YES response 
to one of the age/sex categories in Box 1 
or Box 3, does that mean he/she will 
definitely be a Sample Person? 


Not in Box 1. The top half of the 
sampling page requires a decision. That 
is, if you find potentially eligible people 
in Box 1, you will ask Q14. Q14 will 
decide if those people are actually 
selected. If you are sent to Box 2, they 
are selected; if you are sent to Box 3, 
they are not selected. The bottom half 
of the sampling page does not require a 
decision. If you find potentially eligible 
people in Box 3, they will always be 
selected, as instructed by Box 4, item a. 


Then if you have selected any person 
through either Box 1 as instructed by 
Box 2 or through Box 3 as instructed by 
Box 4 item a, you will select all persons 
less than one year old (as instructed by 
Box 4, item b). 


If a neighbor refuses to provide his/her 
name, address, and telephone number, 
does the information he/she provided 
about the selected DU still count? 


Yes. However, you will almost always 
have the address since you are at the 
neighbor's home. Record as much 
information as the neighbor will provide 
or that you know and note that the 
remainder was refused. 


I am confused about halfway houses and 
group homes and whether they should be 
included as DUs. Are there some rules 
for us to follow? 


Please refer to page 3-4. Those units 
under the DO LIST column should be 
included as DUs. If you have any 
question about whether one of your 
cases qualifies as a DU, discuss the 
Situation with your supervisor. 


How should we explain to ineligible 
households that we do not need to do 
any interviews (beyond the Screener)? 


Explain that people are randomly 
selected at household addresses just as 
addresses are randomly selected within 
communities. This random process is 
very important and by participating in 
this selection process (the Screener), the 
respondent has really helped with the 
study. Then apologize but explain that 
no one at this address was selected. 


Why are we sometimes selecting more 
than one SP from a household? 


People are randomly selected based on 
age and sex at rates determined by our 
Statisticians. We want to give everyone 
a chance of selection and therefore, do 
not limit the number of persons who can 
be selected from a given household. 


HOUSEHOLD QUESTIONNAIRE 


One of my respondents reported buying 
vitamins at a specialty store. Should 
that purchase be included in the amount 
recorded at Q5? 


No. Notice on page 13-5 that we are 
only concerned with food purchases in 
this question. Do not include non-food 
items, such as vitamins. 


In Q52 there is a category NOT A 
HOUSEHOLD UNIT IN 1993. Should 
this category only be used when the 
male and female head of household did 
not live together or can it also be used 
for roommate situations? 


It should be used for either situation. 
The specification on page 13-27 should 
mention roommates in addition to 
mentioning the male and female head of 
household. 


At Q56, how should I record income 
from a source not specifically listed and 
which I am not sure should be included 
in one of the categories (e.g., state 
disability)? 


If you are not sure whether an amount 
should be recorded, record it with a note 
providing the source of payment. We 
can then make the determination at the 
home office. 


INTAKE QUESTIONNAIRES 


If I run out of room on the Quick List, 
what should I do? 


It is unlikely that you will run out of 
room but if you do, simply fold the 
Quick List under and continue to record 
on the questionnaire cover. 


If my SP goes into great detail during 
Q1 of the Intake, may I interrupt 
him/her? 


We do not want you to interrupt the 
respondent during the Quick List. 
However, especially during the Day 2 
Intake, the respondent may go into a 
great amount of detail. In that case, you 
may use the sentence from QI] of the 
Day 2 Intake: "I'll ask you for the 
detailed descriptions and amounts later." 


When should I use Hand Card I1? 


Whenever it is needed to help explain 
the reference period to the respondent. 
It is important that he/she understands 
we are asking about the previous day 
Starting at 12:00 am and ending at 11:59 
pm. 


When interviewing a child with an adult 
assistant, who should respond to the 
Quick List (i.e., Q1)? 


Our preference is that children ages 6 - 
11 complete the Quick List by 
themselves and then be assisted by the 
adult. However, it is acceptable for the 
child to interact with the assistant when 
reporting food items in the Quick List. 
On page 7-4 of your manual, delete the 
phrase in parentheses in the first 
paragraph. That is, the second sentence 
should read: "After the child reports the 
Quick List, address the next statement to 
both the child and the assistant.” 


When do I need to ask Q2? 


For the first food item listed on the 
Quick List, for each food item where the 
answer to Q6 is another time, for each 
food item for which Q6 was not asked, 
and for each food item that does not 
have a time noted in Q2. Remember it 
is important that you read Q2 exactly as 
written. 


Do I need to rewrite the food item in Q4 
if the name/kind is the same as that 
written in the Food/Drink and Additions 
column? 


No, you do not need to rewrite it if it is 
the same (e.g., pinto beans, grapefruit 
juice). However, do not assume it is the 
same and always record the final 
response in Q4 (e.g., if respondent 
reports butter but used margarine, 
margarine should appear in Q4). 


I'm confused about when to use 
brackets. Please review. 


Always bracket combination foods. 
These are foods with additions and foods 
with separate ingredients. Please see 
pages 14-25 through 14-30 of your 
manual for a definition of combination 
foods. 


If the respondent has reported the 
amount as part of Q4, is it necessary that 
I read Q5? 


Yes. You must always read QS. It is 
very important that the respondent 
understands (and you record) the amount 
actually eaten or drunk by the SP. 


If in response to QS the respondent says 
“1 cup,” do I need to confirm the 
amount? 


You should always confirm the amount 
reported by pointing to a measuring 
guide if the respondent did not use a 


guide to estimate the amount. If the 
respondent reports in_ tablespoons, 
teaspoons, or portions of teaspoons, you 
should also confirm that it was a level 
amount. 


In Q6, what is meant by the phrase ASK 
IF NOT OBVIOUS? 


“If not obvious" means if you have not 
made a note in the Quick List about the 
time or eating occasion. 


What is the purpose of Qs 7 through 9? 


With these questions, we are trying to 
find out which food items came from the 
home food supply. This means: 1) 
foods that were purchased in a store, 
taken home, and eaten; 2) foods that 
were purchased in a restaurant or fast 
food place that were delivered to the 
home or taken home and eaten; and 3) 
foods that were eaten in those 
establishments and taken home as 
leftovers. For examples of when Q9 is 
appropriate, see page 14-61. 


If at Q29 and Q30, the SP does not 
know or refuses to report his/her height 
and/or weight, should I record my 
observation in the margin? 


No. We are only interested in the 
respondent's answer to these questions. 
If the respondent does not know or 
refuses, make the appropriate marginal 
note (i.e., DK or REF). 


May I erase on the intake grid? 


No. Please cross out when you record 
incorrectly on the grid. If you find 
errors during your edit, mark IE or ME 
followed by the hanger or a word in the 
probe (e.g., ME type) for errors in Q4; 
and mark IE or ME followed by amount 
(e.g., ME amt) for errors in Q5. 


Is it necessary for a child 6-11 to be 
present for the entire intake? 


We want the child to be present through 
Q15 (the water question) and then be 
available to answer Q35 (the TV 
question). 


If a child SP and his/her adult assistant 
disagree about the answer to a question, 
what should we do? 


Let them work it out. If they cannot 
come to an agreement, record the SP's 
response. 


If I am interviewing a proxy/assistant 
and he/she remembers a food not 
reported on his/her own intake, may I go 
back and add to the Intake? 


Yes, as long as both interviews are 
being conducted on the same day. 


FOOD INSTRUCTION BOOKLET 
(FIB) 


If a baby eats ground up table food, 
should I ask the probes from the baby 
food section? 


No. Page 3 of the FIB refers only to 
commercial baby food. If the 
respondent purees table food, that should 
be probed from the appropriate category. 


If a child drank milk at school and does 
not know what kind it was, is it helpful 
to get the color of the milk carton? 


Yes. This could be particularly helpful 
in retrieving the data. It is possible that 
the child has a choice of milk and the 
color will help the school distinguish the 
kind of milk actually drunk by the child. 


When asking about soda (page 10), what 
should I record to the probe "was it 
decaffeinated or not decaffeinated" if the 
respondent says "it was regular?" 


You will need to ask the probe again 
because we need to know what the 
respondent means by the word regular. 
Do not assume you know and do not 
record regular as the answer to that 
probe. 


If the respondent reports drinking 
homemade alcohol, which FIB category 
should I use? 


Use the nonalcoholic and alcoholic 
(beer, wine, cocktails) and liquor 
Category on pages 12 and 13. 


When asking the amount of french fries 
actually eaten (page 34), do I need to ask 
the number of pieces? 


Please notice there are 4 ways to record 
the amount of french fries eaten. For 
example, if the fries were from a 
restaurant or fast food place, you only 
need to know the size of the order that 
was eaten (or portion of the size order). 


If a respondent reports the amount of 
vegetables eaten as a volume, the FIB 
instructs us to ask whether it was raw or 
cooked and to ask the form. I don't 
understand why? Isn't this information 
part of Q4? 


QS is not asking whether the SP ate the 
vegetable raw or cooked but rather 
whether the quantity reported is for a 
raw or cooked vegetable. For example, 
consider spinach. A cup of raw spinach 
represents a different amount than does a 
cup of cooked spinach. 


If the respondent reports a game meat, 
which FIB category should I use? 


Use the beef, lamb, veal, and game 
meats category on page 37. 


Why don't we ask the brand name for 
pizza? 


We do. Please notice the probe on page 
45: “If not school cafeteria - What was 
it?" If the pizza was obtained from a 
school cafeteria, we do not ask for the 
brand name. If a pizza is from a fast 
food supplier but is part of the school 
lunch served, it would still be 
considered a school lunch pizza and we 
will not get the brand name. However, 
if the pizza was purchased from a fast 
food concession on a school campus, it 
would be considered a fast food pizza 
and we would get the brand name. 


When asking about the amount of pizza 
actually eaten, do I need to get 
dimensions? 


Not necessarily. Please notice that there 
are a number of ways to record the 
amount of pizza eaten. Please review 
these on page 45. 


If the respondent reports eating a fast 
food hamburger, is it necessary to ask 
the first probe on page 55 (name of 
item)? 


Yes. Sometimes respondents will use 
hamburger in a generic way. You could 
easily get a more complete name (e.g., 
Whopper, Big Mac, etc.). 


I'm confused about how to record 
sandwiches. Please review. 


Remember the demonstration on the last 
day of training. We want to get all of 
the ingredients and amounts in Q4; that 
is, we want to construct the entire 
sandwich in Q4. Then, we want to 


know how much of the sandwich the SP 
actually ate in Q5. 


If the respondent reports eating cheese 
and crackers, which FIB category should 
I use? 


If the respondent reports cheese and 
crackers as one food in the Quick List, 
transfer to the Food/Drink and Additions 
column and ask the cracker probes (page 
67). If the cheese and crackers were 
commercially prepared (i.e., the 
respondent purchased a package of 
crackers with cheese on), the crackers 
probes on page 67 are all you will need. 
However, if the respondent put cheese 
on his/her crackers, cheese will be 
recorded as an addition and you will 
need to ask the cheese probes on page 
23% 


What should I do when a respondent 
does not know the answer to FIB 
probes? 


Don't know (DK) is an acceptable 
response. However, be sure your 
respondent understands that he/she may 
look at food labels, etc. 


May I use common abbreviations when 
recording responses to the FIB probes? 


The only acceptable abbreviations are 
those listed in the FIB under the 
Abbreviations tab. You will be notified 
of any additions to this list. 


I forgot what to say when I see three 
dots in the FIB. Please help. 


Three dots (...) always mean "or 
something else." It is important that you 
Say this so that the respondent does not 
feel limited by the question (i.e., does 
not feel that he/she has to choose from 
only those items listed). 


There are some foods I would like to see 
added to the Index. What should I do? 


Feel free to personalize the FIB as you 
need to. There is space at the end of the 
Index to add foods or you may write 
foods in the Index in alphabetical order. 


When should I read the questions in 
parentheses? 


The questions in parentheses are to be 
asked only if the respondent can not 
respond to the first question. 


When do we use thickness sticks? 


The FIB tells you when to use them. 
The thickness sticks should only be used 
for recording the thickness of three 
foods: meat (page 37), poultry (page 
42), and cheese (page 23). 


If the respondent mentions a food and I 
don't know which FIB category to go to, 
what should I do? 


Whenever you don't know where to go 
for a food and there is more than one 
ingredient, go to mixed dishes (pages 52 
and 53). If the food does not have more 
than one ingredient, ask the respondent 
to describe the food item a little so that 
you are able to classify it. 


When can I reference a food with 
ingredients back to another SP? 


Only if the food ingredients are the same 
or have only one change. Remember 
that if you reference back to another SP 
you must always ask the SP if he/she 
added anything to the food. 


If the SP drank coffee a number of times 
during the day but does not know how 
much was drunk each time, what should 
I record? 


If the SP does not know the amount 
eaten/drunk for each occasion, at one of 
the occasions record the total amount 
and refer the other quantities to that 
amount. 


The respondent reported eating "8 
ounces" of popcorn so:I recorded 
"8WO." Was that correct? 


Not necessarily. You must ask what 
was meant by "8 ounces." Did the 
respondent mean "8WO" (e.g., package 
weight) or "8FO" (e.g., 1 cup)? If the 
respondent was referring to the amount 
of popcorn in | cup, record as "1 cup" 
since solids cannot be recorded as "FO." 
Remember, you must also record 
whether the amount reported was popped 
or unpopped. 


DIET AND HEALTH KNOWLEDGE 


SURVEY QUESTIONNAIRE 
(DHKS) 


Since we do not obtain last names, 
Should I address the appointment 
reminder card using only the first name 
of the selected respondent? 


At the time you arrange the DHKS 
appointment with the selected respondent 
(right after his/her Day 2 Intake), you 
should ask the respondent to record 
his/her name and address on the card for 
you. This will serve two purposes: 1) 
we will be sure to have the correct name 
and mailing address; and 2) it will 
introduce the card to the respondent so 
that he/she will recognize it when it 
arrives. 


If the respondent mentions a_ health 
condition not listed in Q6, should I 
always code 17 for health problem not 
specified? 


No. Please review the specifications on 
page 15-15. Notice that if the 
respondent provides a response that is 
not on the list, you should code "00" 
and specify the health problem. You 
should only use code 17 if the 
respondent knows the behavior is not 
healthy but cannot name any specific 
health problem. 


There is a box instruction after Q23 that 
sends me to Q26. When would I ever 
ask Q24 and Q25? 


After Q16, there is a box (Box 1) which 
instructs you to review the answers to 
Q16. If the respondent answered 
NEVER (4) or NEVER SEEN (5) to all 
parts of Q16, he/she does not use food 
labels. Therefore, questions 17 through 
23 are inappropriate to ask and we skip 
you to Q24 and Q25. On the other hand 
if the respondent does use food labels 
(code 2 in Box 1), questions 17 through 
23 are asked but we skip Q24 and Q25. 


Should sweet potatoes be included in the 
response to Q27? : 


No. However, sweet potatoes should be 
considered when responding to Q28. 


FIELD MANAGEMENT SYSTEM 
(FMS) 


If I experience a loss of power (or 
interruption of power) while working on 
the FMS, what should I do? 


Nothing. When you lose power, your 
PC will automatically begin using 
battery power. Since the battery 
recharges whenever the PC is plugged 
in, you should have plenty of battery 
charge to complete your work during 
that session. 
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MEMORANDUM 

bO: What We Eat in America Interviewers April 20, 1994 
Memo #219 

FROM: Judy Meader and Susie McNutt 


SUBJECT: Field and Food Issues 


Your diaries and general inquires raised a lot of good questions, not all of which were addressed 
in the Newsletter. This memo will answer all other questions you have brought to our attention. 
Please read the memo carefully and annotate your manual or FIB, as appropriate, as you start your 
Quarter 2 assignment. 


Collecting Age Information on the Screener - In almost all cases, you have done an excellent 
job collecting complete household enumeration data. That is, all questions in the enumeration grid are 
answered for all household members. In a very small number of cases, you have not been able to 
collect the age of one or more household members. You must make every attempt to collect the 
birthday (Q11) and/or age (Q12) of each household member. If this is not possible, please follow 
these revised instructions to complete the enumeration grid. 


= If the age is unknown or refused, determine the household member's age range by referring 
to the sample message label and asking, for example, "Are you/Is (NAME) 40 to 69 years old?” 


= If this is not possible, collect the age information required to determine if the household 
member is eligible for selection. For example, "Mary, could you please tell me if you are 40 or 
older?" 


= Indicate that the message label range was asked by noting on the screener, next to the sample 
message box, "Asked range." 


s With supervisory approval, assign a screener status code of complete with a household 
member (either S01 or S04, as appropriate). 


Using the Age Chart in the Handcards - The age chart must be used to determine age at the 
time of screening. After checking the chart and while recording age on the grid, you should say to the 
Screener respondent something like "And John is 45 years old?" This is a way of confirming your age 
chart. To determine age proceed as follows: 


Refer to the third Hand Card and the birthdate in Q11 to determine the person's age. To use the 
Age Chart, start with the person's year of birth. If the person's birthday is on or before the date of the 
interview, the "Yes" column will list the age. If the person's birthday comes after the date of 
interview, the correct age will appear in the "No" column. Verify the age with the respondent. 
Record the age as a 3-digit number. Circle the code for years or months. Remember, a child's age 
should be recorded in months if the child is under a year old. 


Seasonal Dwellings and Vacation Homes - Spring and summer bring a new dimension to 
screening if you are working in an area with vacation cabins, fishing camps, or other seasonal 
dwellings. In these areas, you must first establish that the residents DO NOT have a usual residence 
elsewhere before enumerating the household. As stated on page 5-4 of the Interviewer Manual, "The 
usual residence or home is the place the person lives most of the time." By "most of the time,” we 
mean six months or more of the year. Therefore, a family at its seashore home for the summer is not 
eligible for survey participation at the shore if they reside at the shore home for less than six months of 
the year. 


Food Instruction Book Issues - As you know, not all foods fit into the FIB categories. 
Occasionally you need to obtain information not asked for in the FIB to ensure the food description is 
complete. Many of you have asked for the correct way to record these foods. Below is a list of 
interviewer questions and recording instructions. Please continue to ask for recording clarification, it 
helps all of us. 


Q. I can't find pig's stomach (also known as tripe) and chitterlings in the FIB. What do I 
do? 

A. Tripe and chitterlings can be probed from the Liver, Organ Meats category on page 39. 

Q. Are the probes for a breakfast sausage and biscuit sandwich found in the Sandwich, 


Frozen Meal, or Fast Food category? 


A. If the sausage biscuit sandwich is frozen, go to the Frozen Meal category (page 47) in the 
FIB. If it is a fast food brand such as McDonald's or Hardee's, go to the Fast Foods 
category (page 55). And, if it was put together by the respondent, go to the Other 
Sandwiches category (page 60). 


Q. How do you record chocolate milk when the respondent reports the milk was made by 
adding chocolate syrup to white milk? 


A. Treat the chocolate syrup like an addition to milk (even though the FIB doesn't probe for 
additions). Record milk on one line with the description in column Q4. Then record the 
syrup on the next line in the Food/Drink and Additions column. Record the quantity of 


milk consumed in column QS, then go to page 19 for the chocolate syrup description, and 
record the amount in Q5. 


Q. In the Ready-to-Eat Cereal category, the first probe asks for the BRAND name. Does 
that mean the name of the cereal or the manufacturer's name? 

A. Please give us both the cereal and the manufacturer's name, like General Mills Cheerios. 
Some interviewers are only recording the manufacturer's name, which cannot be coded by 
Westat. 


What do you-do when a subject reports drinking a beverage from a self-serve soda 
dispenser that was a mixture of flavors and both caffeinated and decaffeinated? 


Ideally, we would like to know the different brands of soda in the beverage (i.e. Coke, 
Ginger-ale, Sprite, etc.) with an approximation of the portion drunk of each brand. If 
that is not possible, try to get an estimate of the portion that was a cola versus non-cola. 
And in addition, the amount of cola that was caffeinated versus decaffeinated. The 
portion amounts should be recorded in Q4; the total consumed, in QS. 


How should I treat homemade salad dressing? 


Homemade salad dressings are treated the same as commercial dressings in the Salad 
Dressing category on page 69. Record "no brand - homemade” for the probe under the 
hanger BRAND. Make sure the salad dressing name describes the dressing such as Uncle 
Charlie's Blue Cheese dressing not “Uncle Charlie's favorite dressing." 


Where do I find peanuts and corn dogs, they are not in the Index? 


Probes for peanuts can be found in the Nuts, Seeds category on page 68 and for corn 
dogs in the Hot Dogs category, page 57. The Index is not a complete listing of foods and 
these items are not in the Index. Blank lines are provided at the end of the Index for you 
to write in commonly reported foods not listed. In the next revision of the FIB we will 
update the Index to include suggested foods such as peanuts and corn dogs. 


What do you call "plain old bread” that's not sandwich, Italian, French, raisin, or pita? 


Record "plain old bread" as sandwich bread. 


How do you record a prepackaged tossed salad that is mixed with cabbage and carrots? 


Use the Green Salads category. If the respondent cannot report the ingredient amounts, 
record “DK amt" next to each ingredient listed in Q4. Remember to report the total eaten 
in cups in QS. 


I can't find Spaghetti O's or "canned" pasta of any kind in the FIB. Where is it? 


The Spaghetti category, page 50, contains probes that are appropriate for canned pasta. 
Under the Q4 hanger IF COMMERCIALLY CANNED are three probes. When you ask 
Q5, “How much of these Spaghetti O's did you actually eat?", record the response as 
pasta and sauce mixed together. 


We have a fast food restaurant in my area of the country called Sonic. It's not listed in 
the Fast Food category but it's really difficult to put a fast food hamburger through the 
Other Sandwich category. What should I do? 


For a fast food hamburger other than those listed, the FIB refers you to the Hamburger 
on Bun category, page 56. The probes in this category are specific enough to 
hamburgers that the respondent should be able to accurately describe the sandwich. 
During this survey USDA will be updating the fast food categories. Sonic hamburgers 
and other regional fast food chains may be added to the data base. But in order to 
accurately categorize these foods, you have to probe for as complete a description as 
possible from the respondent. Feel free to send in market check information so the data 
base can be expanded. 


Which category do I use for nachos? 


If nachos are tortilla chips with toppings added in preparation such as refried beans, 
peppers, olives, and cheese, go to the Tacos, Burritos, Enchiladas, and Fajitas category 
(page 46). If the respondent is referring to plain tortilla chips, go to the Chip category 
(page 67). 


How do I record a dry protein powder mixed with plain water? If I follow the FIB I 
would mark the water off. But because it was added to the protein powder it should be 
bracketed and an amount recorded. This is unclear. 


You are correct, the FIB does tell you to mark the water off if it is not carbonated and 
has no additions. But in this case, we are interested in the water because protein powder 
was added to it. We need the amount of water to which the powder was added. Just as 
you suggested, record the water as a separate line item with the quantity drunk in QS, and 
bracket the powder and water. Remember to collect the amount of powder also. 


Butter in restaurants is not always served in a pat or container. How do I report the 
amount? 


Report the amount of butter consumed as a volume (e.g., tsp, or Tbsp). 


How do I record homemade carrot juice? 


Record all homemade (or commercial) 100% fruit and vegetables juices (except orange 
juice) using the Juices (100%), Nectars category on page 9. For the Vitamin C probe, 
record "DK Vit C -- no label"; for the BRAND probe, record "no brand": and for the 
Type probe, record "homemade". 


How do I record homemade french toast? The FIB French Toast category seems geared 
to commercial products. Don't you need information about the type of bread, eggs, milk, 
and fat? 


No, we don't need to know the ingredients used to prepare the french toast. Use the 
French Toast category (page 18). It is important to record whether the slices were 
regular or thick in column Q5. 


I can't find chicken wings in the FIB. I know that often people eat just the drumette part 
of the wing. How should I record this? 


Use the probes in the Poultry category (page 42) to collect information about chicken 
wings. Record drumettes when the respondent reports them. 


How do I record frozen chicken parts? 


There is no need to record "frozen" chicken parts. It makes no difference whether the 
chicken parts were fresh or frozen before they were cooked. What is important is what 
parts were eaten and how they were prepared. 


Flavored coffees from a coffee cart or from a mix have milk in them, but the respondent 
would not know how much. What do I do? 


If the coffee is from a dry mix (such as International Coffee products), follow the FIB by 
asking the probe after the hanger If powdered mix. If the coffee is from a coffee cart 
and has other ingredients added in preparation, such as in cappucino and cafe latte, record 
the name of the coffee and that it was from a coffee cart. Record DK form if the 
respondent does not know the form. Then ask the probes after the TYPE and 
ADDITIONS hangers. Do not try to collect the amount of milk used in preparing the 
coffee. 


There is no category for onion rings, what information should I obtain? 


You are right, there is no specific category for onion rings. However, by modifying the 
Vegetable category (page 35) you can obtain the information needed. Change the probe 
after TYPE to read “Was it raw, pickled, cooked, or batter-fried?” Ask TYPE, SALT, 
FAT, and ADDITIONS for onion rings. "Funyuns” or other onion-flavored snack type 
rings should be recorded in the Chips section. 


How do I record additions to orange juice? In my part of the country many people add 
ingredients to their orange juice such as brewers yeast and bran. 


Record additions to orange juice following the ADDITIONS procedures. In this case 
neither brewers yeast or bran need more description. So, you would record brewers 
yeast on one Food/Drink and Additions line and bran on another. Record "brewers 
yeast" and "bran" in column Q4 on the appropriate lines, and then record the amount of 
yeast and/or bran drunk in column Q5. 


I can't find a food category for dumplings. Where do I go? 


If dumplings are part of a mixed dish such as chicken and dumplings, record the 
dumplings as part of the ingredients in the mixed dish. If the reported dumpling is a side 
dish, such as pork dumplings, go to the Mixed Dishes (Commercial, Restaurant, or 
Recipe Unknown) category and record the ingredients in Q4 and the number consumed in 
QS. If the dumpling is fruit-filled, such as an apple dumpling, use the Pies, Tarts, 
Strudels, Turnovers category, recording the number of dumplings eaten in Q5. 


The Pizza category does not ask for enough description for pizzas made from a home 
recipe. What do I do? 


You do not need to collect more information for a homemade pizza. Record the 
respondent's description of the pizza using the probe after the hanger KIND (i.e., bacon, 
Sausage, extra cheese, and type of vegetables); the crust thickness; and “no brand - 
homemade" for the hanger BRAND. 


Should potatoes and carrots cooked with a pot roast be recorded as a mixed dish (with the 
potatoes and carrots as ingredients), or should the potatoes and carrots be considered 
additions to the meat? 


Record the vegetables as additions to the meat. Put each one on a separate line in the 


Food/Drink and Addition column, describe them in Q4, and record the quantity eaten in 
Od: 


Hamburger Helper is not in the FIB. What do I do? 


Use the Mixed Dishes (Commercial, Restaurant, or Recipe Unknown) category on page 
53 to probe for Hamburger Helper dishes. Hamburger Helper is a manufacturer's name 
for a variety of boxed main dish products that require adding hamburger. There are also 
Tuna Helper and Chicken Helper boxed mixes. Record the product name after the hanger 
BRAND (such as Hamburger Helper Stroganoff or Hamburger Helper Rice Oriental). 


3.J Interviewer Debriefing Questionnaire 


Showing Tally of Responses and Comments 


peor teers 
j 


it: ii Se reveal. 3 he sing ant * 3 


in wo Part of ie cckeneeyy We 
i | x ore! Pear. 


Dri TIONS procedigess : 5) 
‘pes. Se, yor woold- ceil 

oT! of acoier Nang 
tate {ines and? diem comming ii 


1 = chicken aod dhomplinges 
Ai he Teo red LDR 

i] 4% 4 Oral hac ta. 
4 gn the ser oe 

: ap Wig, We the he 

gs eaten in Waa 


cripon for plares made 


SK mace? — . 


jo aleT eniwode 


as! Qe rogue! 8&2 2 ieee 
ig Ihe PUUIORS BHO Cerrar aRe 


‘vi Gicid OE Of 2 Se 
r 4 end rec d Lié tu 


fectpe Uolknewni. 

nit Hope 4m 

i? @ Steg Oepburget: 

o > 9 prodges ane aftela 

TD 30 Hetper Rice se 


a a 


NAME: 

SUPERVISOR: 

PSU #: 

PSU NAME OR LOCATION: 


what we eat In 


WHAT WE EAT IN AMERICA: 1994-1996 
CONTINUING SURVEY OF FOOD INTAKES BY INDIVIDUALS 
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In which region of the United States do you primarily conduct interviews? 


NORTMEAS Ieee 19 
MIDWES Pere eece tte -ac- Ze 
MOUTH Stee ee: 23 
WES Titec citteteeecee 13 


The following questions are designed to help Westat learn more about the "What We Eat in America’ 
study. You, as an interviewer, have the most experience with the data collection. Your ideas and 
suggestions will be considered when planning for the 1995 and 1996 Survey. For each question below, 
please circle the code or fill in the blank. Keep in mind any special problems you may have encountered 
while interviewing. 


CONTACTING THE HOUSEHOLD 


cme Take a minute to think about the introductory letter, brochure, flyers, and your handbook. 


a. How often do you use these materials to convince reluctant respondents, avoid refusals, 
or convert refusals? 


b. How well do these materials work to convince reluctant respondents, avoid refusals, or 
convert refusals? 


De Is there sufficient information provided to introduce respondents to the survey and to the subject 
matter of the Screener, Household Questionnaire, and Intakes? 


If no, what other information should be provided? Information about the specific uses of the 


CSFIl data and how respondents can find out about survey results. (5)* 


ih Do the respondents have difficulties classifying themselves into the precoded categories in 
Screener questions 9 and 10, the race and national origin questions? 


If yes, what are the difficulties? Hispanics and Puerto Rican respondents have difficulty/refuse to 


classify themselves as anything other than Hispanics. (9 


4. During quarters 1 through 3, approximately 10 percent of the Screeners were completed with 
neighbors. Did any of the following contribute to your having to collect screener information 
from neighbors? 


YES NO 
Locked buildings. Of COMPIOXCS Fe onc sserpn~ cava seh <ceceopupsceaseneder 34 43 
Refusals at the selected NOUSEHOIC ......... ees eseeeeeeeeeceeeeeees 46 31 
Inability to contact selected NouSehold ..............:cssceeceseereees 67 10 
Other situatlonsdSPECIRY) ite cceee 2s, :2. pe cannshanasuepansanan 9 68 
5! Did you encounter any difficulties obtaining screener information from neighbors? 
BA Ree ert le eth er ape Mia bo - 48 
NO ee a anne ee 29 


lf yes, what were the difficulties? Some neighbors did not know the respondents. (15) Neighbors 


were reluctant to give any information/privacy issues (40 


6. What flow of work is most efficient for you, or how do you best manage your workload? 


Complete one area or segment at a time (21) 


*. . . . . . . . eae 
The number in parenthesis following a verbatim response is the number of interviewers providing the response. In most cases, only 
verbatim responses reported by two or more interviewers are documented. 
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10. 


HOUSEHOLD QUESTIONNAIRE (HHQ) 


After screening and identifying the SPs, how do you introduce the Household Questionnaire? 


Please describe: __ - Some interviewers go directly into the HHQ without interruption: (7) 

- "This Questionnaire has to do with your food shopping habits and what you spend." (18) 

- "The first Questionnaire I’d like to do is what we call a Household Questionnaire. This requests 
information about food purchasing, preparation, and other information about household 
characteristics." (23) 


Have you encountered any difficulty choosing the HHQ respondent? 


If yes, please describe the difficulty: 


If the HHQ respondent is not the Screener respondent or has not completed an Intake, do you 
have enough information to introduce the HHQ? 


If no, what other information should be provided? 


In most cases, the measuring cups and spoons are given at the start of the Household 
Questionnaire. Do you find that giving the gift at this time is helpful in gaining the cooperation of 
the household? 


If no, why not? ___Respondents have already decided to participate in the survey. (4) 


Are most respondents’ reactions to the CUPS and SPOONS.... 


POSITIVE Cietsre ot, et cses crete tuum Obs, cach to cotic 72 
INDIFFEREN Vieissrccotcerteretcsctiurnscroneattes 5 
NEGATIVE Sits sets ts cctetnns sce ieearssvake ores 0 


12. 


In quarters 1 through 3, about 15 percent of the occupied households selected for survey 
participation refused to complete the HHQ. What are the most common reasons for refusal? 


- The respondent(s) has already refused to participate in the entire survey. (13 
- The financial questions (21) 
- Lack of time/too busy (19) 


Please describe some of your successful HHQ conversion techniques: 

- Leave the HHQ until the first Intake is completed. There will be a greater rapport with the 
household and less resistance to the more sensitive questions. (7) 

- Explain the confidentiality of the information collected. Also, explain the importance of the 


information and the purpose of the survey. (20 


In the HHQ, Q 49 refers to net income received from the business or farm ONLY. 


a. Do you understand the question clearly? 
NY ES ete carers tremens ete cers note tan tenss ssemnerate 75 
NOI eet. See. Pe een 1 
NO. ORINION Se 0 120 SU teat ceorens 1 
b. Do you think the majority of your respondents understand the question? 
IY. ES eens a licence roe ceee nese aeemoey 68 
NO 4 ds se eto nh hatte a Me v4 
NO ORINIOIN Sexe ree Perens eae 2 


INTAKE QUESTIONNAIRES 


DAY 1 INTAKE 


15. 


16. 


Ee 


Do you experience any difficulty asking the food questions in the order that they are presented? 


Which series of questions causes difficulty? Sandwiches (2), mixed dishes (2), 


the review (3 


Are there any questions in the Intake that the respondent has difficulty understanding? 


Difficulty and Suggested Revision 


What is a fish oil supplement? (3) 
Any other alcoholic beverages? Are there any? (5) 
Confusion about water sources. (3) 


Understanding the difference between vitamins (2) 


Please rate the following items: 


ee 
ee 
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NO OPINION 


19: 


20. 


ZA 


At times interviewers have difficulty recording certain food items as trained (i.e. additions to food, 
ingredients for salads and mixed dishes, or some specific food items). 


Which foods, if any, are difficult for you? Some sandwiches (12), mixed dishes (22), ethnic 


foods (8), salads (7) 


Do you have suggestions to improve the procedures? Create a better index (4), add more fast 
food restaurants - include regional restaurants (5), ask for home recipes (2), simplify hangers and 


delete some (4) 


How often do you use the thickness sticks? 


FREQUENT LY eects aces erecemseree es 2i 
SOMETIMES 2. 000.chse-cocssseronseerenentreeseacesaree 30 
PRAPELLY oo ocstercsccvecestteccpsossconatvaveaisyees eeees 19 
NEVER saatiectaesec an tare ane 1 


YES NG 
Cak@icices esas 2. ste nn eneetees cece Ceo Bt IED. SEEDS craw beseaess 12 65 
Che OSC cereanieinsdecerscceeseerevsartatees seen eee eee erent 57 20 
Fist oeesie ce sh pes ccleve la Oe SeacuscPl eset aas cami tae a ea eee eR EUs che eat 25 52 
Meats ssnccceccccte ancl Sods cc tthe MAR Crest te eee MERLE Sack was cneaaaess 63 14 
PIZ 20 -cecevcoteenteeru te cei astern ae eee ene aneten eae rele peters 10 67 
POUMIY eeecccec tence etc pees ge ste eee ana aan ntese ce aaa tence oocaiuaea st 19 58 
Vegetablesiysrrscaieric2. 5 Sees acest sattacces tetra tach nsgevbesacene 5 %2 
Other- (SPECIFY) sxsetcescpesersercs toes ortom eee ettenten seatena taerereeenere 8 69 
Do you use the ruler for estimating the size of foods... 

FREQUENTLY 2 oe eeeece eee eee 40 

SOMETIMES 2yin cette ee eae 26 

PAR ELY ieee isc. no50cceatscsa pas taeoeresexemnaeneae 8 

NEVER 2ietet tcc sycascescastreratecensececeateesseetests 3 


2A. 


23. 


24. 


ZO. 


26. 


Did you usually use the ruler for any of the following food items? 


reo NO 
CE ON Sooo ove nck das'sipsbenaccneasant 32 45 
CA CK SUS eterna tersse seeps tenne SIM scene asaeacee Stee Teateat 29 48 
CHEGSO a ee OMI es fossciladasclaasiccrveverts 52 25 
EXOUCUN ILLS seeeree iterate anne e acs sascsccuneat crecscneeevcontysare ase 6 71 
ESS ITU HAG Nts esters fe sasn ches enocevaestontvicdoetteeseacocs 6 71 
CEE es i AE nace ey 7 CO 62 1 
PIZZA eres atten eee PTET ocs co recatyeccesscesnesecevercones 52 20 
Other (SPECUBY | same g weer einer ayet te, ace, nlc ocean oeer cece cane 20 57, 


Cake (13), candy (2), pie (5), sausage (3), vegetables (3), 
lasagna (2), fruit (3), fish (1) 


How often do you use the pint measuring cup to measure the content of the respondents’ bowls, 


cups, mugs, and glasses? 


BREGUEIN Gv ni cnc arse nuns 20 
IL | Ul SERS pen oleae paar tern dein Pe NSE 41 
EAT be Pie Ev acig va asnasdenanecmandincansscanenseess 13 
INES EE errr erent cic st coats tvscucdeatpnir eee 3 


How often do you use the measuring cups and spoons for estimating the amounts of foods? 


EPR GO SIN LEY Serceercee tear cen dt pana state ces teas os 69 
SOMEMIMESE....eecrtrererss.. 2a, 8 
BRAR LYRE cette ae. AEE. netic aosteatesssveect 0 
NEVE Rese Stee Sect). Betty. ..ac cere ieee 0 


AERO oes Sep oe nec Perrine ee eee 34 
INO segeceaee secret eteae rrretreaot reenter eri entnonneesan« 41 
NO. OPINION sBave tree eeees...............-- 2 


If yes, which foods are the most difficult? Salad (5), snacks (9) (potato chips, popcorn, nacho 


chips), portions of food (bites, sips) (4 


How often is the Intake interview conducted in the following places: 


_ ALWAY: NEVER ~ 
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28. 


29. 


30. 


The nylon bag is presented to the respondent prior to the Day 1 interview. Do you find that giving 


the gift at this time is helpful in gaining the cooperation of the SP? 


VES Joie sens ccaneenesuutenaesessssentsdziedes deer reann eos 59 
NOs. cissiesnceasctcosblsdien descachane sean ener rtaaesy 15 
NO_OPINION .sccesc-ostecessccomtevess tonite reste cas 3 


If no, why not? The SP has already decided to participate in the survey. (12 


What are most respondents’ reactions to receiving the nylon bag? 


POSIT IV Biteccerrescecrct ecenccisassratsner mens seer 75 
INDIFRERENT co. tress ceceesc-esxeareeasceanesouseestene 2 
NEGATIVES 22 ieee US) else cease eee 0 


Is the nylon bag more popular with any one demographic group (age, sex, etc.)? 


VES Warps ite ccec cas cctccneousincsstunnsinetnacseen 28 
IN ieesscee trate Seen tceanstnes erie ananee aceon 49 
If yes, which group(s)? Young children/school children (20), females (14 


During the 1994 survey, approximately 14 percent of Day 1 Intakes were not completed on one 


of the three days specified on the label. What reasons contributed to this deviation from 
specified procedures? Rank order the reasons with 1 being the most common reason you 
weren't able to complete the Intake interview on a label day and 4 or 5 being the least significant 


reason. 


Respondent availability .............c:ccccsceseseees [a} 1 
Interviewer availability ............c.:csscesseeseeseeees [a 
Observer's SCHEGUIE ..........cssssessseseeeesteeseees i io | 1 |e 
Refusal CONVErSION .........:.sssecseesseeseeseeeneen [ ] pe [ais |e | 
Other: Multiple Attempts .................ccceee ae 
Other: Jewish HolidayS ................:cscecsceeees jo [0 | ola 
Othera Mistake rs ceca ecru te | cone ae 


on 


Bey 


ine) 


ot 
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31. Although most respondents are eager to cooperate, older men (50+) had the highest refusal 
rate. In your experience, why do you think this situation is occurring? 
- They do not trust the government. (15 
- They think the survey is a waste of time and money. (15 
- The are not interested /too busy. (26 
How do YOU convince older men to participate in the survey? 
- Convince the respondent that the questions will go quickly. (3) 
- Try to determine a common interest and flatter them. (8) 
- Let the respondent know that he is important and cannot be replaced. (6) 
- Sympathize with them and acknowledge the importance of their time. (2) 
- Tell them that you are willing to work at their convenience. (3) 
- Smile and make sure you can answer their questions. (2 
DAY 2 INTAKE 
32. The mug is presented to the respondent as a thank you at the end of the Day 2 interview. Do you 
find that giving the mug at this time is helpful in maintaining goodwill? 
Ys re Oe EN oS, coc oueadegeccnese 65 
NO 2 Aes, SO ee oe eS we BE .. 11 
NOLOPINIOIN Bese ee tee es A oe 1 
If no, why not? __ The SP is expecting to get the gift at the beginning of the interview. (7) 
3, What are most respondents’ reactions to receiving a mug? 
ROSI UV Gieeee e e e 65 
INDIFFERENT eee ee. 11 
NEGATIVE tr re er I  vcsececarss 1 
34. Is the mug more popular with any one demographic group (age, sex, etc.)? 
NES eee tee 21 
ah eed elie rete: Sane dhe Cai A ar Oe ene 56 
If yes, which group(s) oung children/school children (9 
35. In the 1994 survey, approximately 27 percent of the Day 2 Intakes were mistimed. In most 


cases, respondents were interviewed more than 10 days after the Day 1 Intake. What 
suggestions do you have for improving the rate of completion within the 3-10 day window? 


- Allow interviewers to make appointments (16) 
- Extend the window to 3-14 days (8) 
- Go back to the household in 3 days, not 10 (8) 


- Ask the respondents the best times to return (8) 
9 


36. Did you conduct any Day 2 Intakes over the telephone? 


How many? _ one = 12, two = 5, three = 5, five = 2 


What, if any, difficulties did you encounter when administering the Day 2 Intake over the 
telephone? 


How did you overcome the difficulties? 


PROXY INTERVIEWING -- ADULTS 


ome In 1994, did you conduct any Intakes with a proxy representing an adult SP? 
NES 15. Mirteoes ate OTe, SO OP A BE Se 40 
ING Bree sac aes aan Seen ncasscaneeer sees 37 


How many? _ one = 28, two = 6, three = 2, ten = 1 


What, if any, difficulties did you encounter when administering the intake to a proxy? 


How did you overcome the difficulties? 


INTERVIEWING ADULTS ABOUT INFANTS 


38. Have you had any problems obtaining Intake information for infants? 
A AS betes: hen vepsn i lpbelans cele rap einen. Get 9 
ae oe Peart nce ey PRES aie nA met dare en 67 
NOTPAP PEIGABEE Rieeeritttrtecscrtttestrecces ar 1 


If yes, what types of problems have you encountered? Embarassed mothers (1), recording 


times (1), refusal to answer questions (1 


10 


39. 


40. 


41. 


42. 


43. 


INTERVIEWING CHILDREN (6 TO 11 YEARS OF AGE) WITH ADULT ASSISTANT HELP 


Did you conduct interviews in any households with SPs 6 to 11 years of age? 


Overall, did you have any difficulty with the following: 


YES NO 

Chlc cooperation sine at ct ent ees petite aie cree deroe Reet 6 68 

Parent ASSISTANCE ax.1. ca Ned eA cursere saccicee nenseicl vied en.ancan 5 69 
Parent and child conflict 

concerming food, Items: eateniee ete ..<..cc-cccce-<--ncorsa0-cucezesese- 28 46 

Cthen (OP ECIRY) see ,c sc. ceaenae mans ee teers ee ene er cd cs 2 2 


Child vs. child conflict 


Did you ever conduct a follow-up data retrieval call to a school, day-care center, baby-sitter or 
other caretaker? 


If yes, describe the problem(s): _- Not getting a direct answer from the different school systems 
(getting the run around) (11) 

- Trying to determine how much and which food the child had eaten. (4) 

- Hostile school districts (3) 


How did you resolve the problem(s)? Patience 


Did you have any problems with the data retrieval procedure? 


If yes, describe the problem(s): Schools _and_ cafeteria staff wouldn’t return calls and were 


uncooperative. (4) 
How did you resolve the problem(s)? Persistence (3) 


Ta 


FIB QUESTIONS 


Your FIB was updated in July and additional modifications are being made now for use in the 1995 
Survey. We need your feedback to ensure we are improving the FIB. 


44. 


45. 


46. 


47. 


48. 


Is the FIB organized in a way that is efficient for you to use? 


NES csess actus vutecpoce det aateessss Tinea atts gs ot 66 
ING) ek iraccsstsctusdssarteeptesscacscatonsiarvesencovonsiscasemt 9 
NO OPINION 222 ocescecnsapatatvagevsconssetecs suresnans 2 


VES acgeerasacsinexieeatas seecarees Wiese necsseage etre 38 
© eral ie hc opr heen bpettline’ sen Reine te TY 37 
NQIOPINION crccnca sees <tetecss srcensten: ceseute fevee A 


Which ones? _ Ethnic foods (12) 


How often do you use the index in the back of the FIB? 


PLWAY S coccsercrtinss sin atsvincogetconesncurscesecge reece 15 
PREQUENT EY trec.csocst-scrnssoseoasvathecrsvetacrests 36 
SOME IME S ie cce-geostasce,casateessacracestarasni rss 20 
PAR eee len arpa torte canes tanta ranmtsans 6 
NEVER iti tes chee an tees sone. Case estes ee sececcsyectess 0 


Please refer to the index of your FIB. Are there any foods that you have added to the index since 
the new FIB change pages were distributed in July? 


Which foods have you added? _ Bread sticks (3) 


Are there any probes in the FIB that are confusing or particularly hard for the respondent to 
answer? 


Which probes are the most troublesome? 


12 
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49. 


50. 


Are any quantity measures suggested in the FIB difficult to use? 


VESseR tit corte it) OF is MR RL 12 
INLD eae? ne err a Rie PEROT AIR ons PS 64 
INGIOPINION 2c. cereale terete acters 1 


Which ones? _ meats (6), pizza (3), poult 


Are there specific foods that are difficult to quantify? 


VES sai: sel Marthe woe inl (eo; 28 
NG er ee ee ee 48 
NGHOPINION berets neeeee 1 
Which ones? Potato chips (10), popcorn (4), peanuts (4 
13 


Se 


52, 


53. 


54. 


55. 


THE DIET AND HEALTH KNOWLEDGE SURVEY 


Do you experience any of the following difficulties administering the DHKS over the telephone? 


YES NO 
Flow of interviGW. oc: :cc-cnccaunsesonstrne-st aceeene novotaen tontvteteekernre sores Wg 60 
Respondent difficulty with Probes ..............csseseseereereeeeereees 18 59 
Respondent difficulty with understanding questions ............ 38 39 
Following the random start SEQUENCE .............esseeesrreeeereeeees 5 iff 
Other (SPECIFY ite o..ecsecnstt veseetes cate onsuaseecsescrenare acetone Genaane 6 vil 


Too long, Very repetitive 


How frequently do respondents have the DHKS reminder card/answer categories available when 


you are conducting the interview? 


When the respondent uses the DHKS card, how well does it work in helping with the flow of the 


ALWAYS \oreessec-coscsetteasevstescatercedeeysbtenaettens is 
FREQUENTLY vinessesercessssrascovnivestversveneeereres 21 
SOMETIME Soo nncsecsenconperaspsreceereneseazecvenres 31 
RARELY ‘sssvccesscnscsvevcrsovesctersvsstrssameenrenenceetey 13 
NEVER Beatitist.trcvcetercsestercscscraan sorcerers terenrerte 5 


interview and assisting the respondents with understanding the questions? 


On average, how would you rate the pace of the DHKS interview. Would you say it is excellent, 


good, average, or poor... 


EX CELLEN Tere resi ter reine eerenseneraes 24 
C(O, 8 8 Lotti len aeenrermt tr erenen et br seaerinte neha 29 
AN ERAGE tereetteesrecepn tometer ena nenea rena i arena 18 
eh RAC) al serene thn eememronparrtneneien ny Rireme NiCr 1 


EXCELLENT GOOD AVERAGE POOR 


Respondents who are hard of hearin 


With the reminder card?.......................6 
Without the reminder card?.................... 


27), Elderl 


14 


20 41 10 1 
4 24 31 16 


What are the characteristics of respondents who are the best candidates for in person DHKS 
interviews? 


respondents (25), Lanquaae difficulties (10 


Reluctant respondents (4), No telephones (6), Uneducated/slow respondents (10) 


N/A 


5 
2 


56. 


eye 


58. 


The DHKS is conducted 2 to 3 weeks after the Day 2 Intake or refusal. Does this time period help 
or impede the... 


HELP IMPEDE NEITHER 


Response Rate? ...............cccccceeeee 29 34 14 
Household Rapport? ..................... 29 29 19 


What suggestions do you have for improving the DHKS response rate? 


- Shorten the time period between the Day 2 Intake and the DHKS. (25) 


- Allow more DHKS to be done in person. (3 


ALL QUESTIONNAIRES 


Are there places in ANY of the questionnaires that flow in a way that is awkward or difficult for 
you and/or the respondents? 


15 


59. 


60. 


61. 


62. 


63. 


QUALITY CONTROL ISSUES 


Is the feedback on the quality of your work regular enough? 


NB SRS once oketsecsenccncsanmnopssccrarstusecreraniareet? 66 
IN OPP IIT ais sacsacnvcunsexearsaavouneyneeee nschhetenaie 10 
INQUOPINION Miviecrcecrcoceuvsgrestometncsessstetdeeoers 1 


NES See ccccte ves santecrosetonns cescehererssner arti emees 64 
NO. cic cccct chien LE IEEE Silane Seem aeteetee 11 
NO‘OPINIONS. 22: Ack Saeed 2 


What are your suggestions for improving the feedback? 


- Send copies of the corrected intakes to show the mistake. (10 


- It would be helpful to see which Intakes are being referred to. (6 


During report calls, your supervisor conducted a series of “pop quizzes." How beneficial were 
the following exercises: 


ae See en 
a 
ne eee 
Household income section 550 Sit choo. Teerkle Raa 
ee a ee Se 


In reviewing your work, Westat and USDA coders have noticed inconsistent editing or no editing 
of documents. What are the main reasons for incomplete editing or no editing of a document? 
What are your suggestions for improving interviewer editing? 


Reasons: Interruptions (7), there are too many documents to be edited (4), editing is time 


consuming (7), tiring (4), too much to do at one sitting (2). 


Suggestions: Take more time to edit (6), and edit more than once (2). small bonuses for good 


editing. (3 


SURVEY PUBLICITY 


Respondent cooperation can be enhanced by survey publicity. Therefore, early in 1994, USDA provided 
a press release to at least one newspaper in each of the PSUs. 


64. Did you see any news articles concerning the study in your local newspaper(s)? 
YASS pre doen aie 2 ere ae er 9 
[NAG coder pepe eat rere arr bean pea 68 


If yes, what do you recall about the article(s)? _ - Explained what the study was about: it did not 
mention Westat, but did refer to USDA. (1) 


65. Did any respondents report seeing any news articles concerning the study in their local 
newspaper(s)? 
NEES Ste ar ne a ee ne 6 
IN Ore eres ie ees tinct ists cenesee 71 


If yes, what did they tell you about the article(s)? The interview could only take a few minutes 


(1). The respondent wondered if the article had something to do with (my) work. (1) 
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Attachment 3.K 
In-Person Interviewer Debriefing 


The agenda for the In-Person Debriefing of field staff closely followed the Debriefing 


Questionnaire. A summary of the in-person discussion follows. 

Advance Materials and Contacting Households 

Advance letters and brochures were the most positively received and frequently used tools 
for convincing reluctant sample persons (SPs) and converting refusals. Together, they established the 
legitimacy of the survey and were key elements in gaining respondent cooperation. Interviewers also 
agreed that the Spanish versions of the advance materials were welcomed by Spanish-speaking SPs. 


The flyers were less frequently presented to SPs but were effective when used. 


The factbooks helped the interviewers convert borderline refusals and could also be used 


to keep other household members occupied during an interview with an SP. 


The field staff agreed unanimously that the letter of authorization helped to establish the 


survey’s legitimacy with local authorities, apartment managers, and other community officials. 
Interviewers suggested that it would be helpful to have an introductory letter tailored to 
neighbors, to be used when collecting neighbor information to complete the Screener. Similarly, a 


letter of introduction would be useful when collecting missing meal data from schools. 


Most interviewers agreed that the introductions to the questionnaires provided sufficient 


information to the respondents. 


SPs most commonly asked the following questions about the survey: 


8 What is USDA going to do with all of the information collected? 


ws How can I get the survey results? 


a Why/how was my household selected? 
a Do I have to participate? 


wy How long will this survey take? 


The field staff generally agreed that Hispanics, Puerto Ricans, new U.S. citizens, and 
persons of mixed race had difficulty classifying their race. Hispanic and Puerto Rican SPs usually 


classified themselves as Hispanic, and new citizens often classified themselves as “American.” 


Most SPs did not object to the income question on the Screener. When they did ask why 
the information was necessary, the interviewers did not have any difficulty explaining the purpose of 


the question. 


The three most common reasons for completing a Screener with neighbors were that the 


household refused to participate, the SP was never home, and the SP would not answer the door. 


The interviewers discussed the challenges of working in areas with locked buildings. 
Successful techniques included following a resident into the locked building and contacting the 


management office. 


Interviewers used a variety of methods to manage their workloads. Many preferred to 
work a segment until they were nearly finished before moving on to the next segment. Some grouped 
their cases by label days. Others quickly worked the households where, according to the sampling 
message on the Screener, large numbers of SPs were eligible for selection. Some interviewers chose to 


organize their workloads based on the distance from their homes. 


Household Questionnaire 


Interviewers had very few problems identifying the Household Questionnaire respondent, 
because most Screener respondents were able to identify the person responsible for food purchase and 


preparation. 


Interviewers found that the measuring cups and spoons given as a gift were helpful in 


gaining the cooperation of the household. 


The income questions required considerable explanation. Many SPs wanted to know what 
the income questions had to do with food. A few SPs were offended by the detailed questions 
concerning various sources of income. Some interviewers preferred to conduct the Day 1 Intake(s), 


and thereby gain rapport with the household, before attempting the Household Questionnaire. 


Although some SPs had personal reasons for refusing to complete the Household 


Questionnaire, the most common reason was refusal to participate in the entire survey. 


Day 1 Intake 


The handcard was rarely necessary as an aid for clarifying the 24-hour recall period. 


Most SPs had a clear understanding of the reporting period. 


SPs had difficulty understanding a few concepts and questions. Some SPs struggled with 
the difference between the amount of food served and the amount actually consumed. There were 


some problems with the diet questions. Many SPs had not heard of fish oil supplements. 


Interviewers found that SPs responded very positively to the insulated nylon bag. 


Presenting the bag before the interview was often helpful in gaining the SP’s cooperation. 


Most interviewers requested that the Intake interview be conducted at the kitchen table or 
near the kitchen, explaining that it might be necessary to look at food labels. Interviewers were 
generally successful in obtaining food labels when they asked for them. During the Intake interview, 
some SPs had difficulty in reporting quantities for potato chips, beverages consumed throughout the 


day, buffet foods, and some mixed dishes. 


Day 2 Intake 


The interviewers had many suggestions for improving the rate of interview completion 
within the 3- to 10-day window. The first suggestion was to return to the household on the third day 
instead of waiting until later in the window. Another was to use a calendar to help organize the 
caseload. There was also a suggestion that at the end of the Day 1 Intake the interviewer gather as 
much information as possible about SP availability. Some interviewers wanted to expand the window 


to a full 2 weeks, and others wanted to be able to make appointments. 


The interviewers reported no major problems in conducting Day 2 Intakes over the 


telephone. Most SPs did not have any trouble reporting food quantities over the telephone. 


Some interviewers were uncomfortable speaking to proxy respondents while the SP was 


present. 


The interviewers encountered several challenges when interviewing children aged 6 to 11 
with the help of an adult. Sometimes the interviewers had to help the children to recall what they had 
consumed. There were occasionally parent-child conflicts about what the child had actually consumed. 
Some parents wanted to answer the questions for their children, and some were unhappy that the 


children were asked about alcohol consumption and smoking. 


While attempting data retrieval from schools, daycare centers, and other care providers, 
the interviewers occasionally had difficulty demonstrating the legitimacy of the survey. They 
encountered fear from some school officials who thought that USDA was monitoring their school food 
programs. Also, the child and the school (or care provider) sometimes gave conflicting reports about 
the foods that were served. 


The interviewers differed in their opinions about the feasibility of attempting data 
retrieval over the telephone from the SP’s home. Some interviewers believed that this approach 
worked well because it was less intimidating to the care provider. Others said that this procedure 


worked well with relatives and babysitters but was less effective with schools and daycare providers. 


The interviewers shared many ideas about gaining the cooperation of adults aged 50 and 


over. They agreed that gaining the support of the wife was crucial to the older male's participation in 


the survey. Some interviewers believed that the study literature with the toll-free telephone number 
helped to convince older SPs to participate. Interviewers often found that they were able to overcome 


objections to participating if they could determine the SP’s reason for refusal. 


The travel mugs were received with less enthusiasm than the insulated nylon bags, but 


most SPs were very positive about the gift. 


Food Instruction Booklet (FIB) 


The interviewers reported that they had to explain how to use the thickness sticks. There 
were a few general food categories and food items that the interviewers had difficulty recording: these 
included mixed dishes, ethnic foods, vegetables cooked with roasts, and fast-food items not included in 
the FIB. 


Diet and Health Knowledge Survey (DHKS) Questionnaire 


Many interviewers felt that the DHKS was too long and wordy. They agreed that they 
had to repeat the DHKS questions and probes frequently. Some SPs asked the interviewer to interpret 
the questions. Others were frustrated by the questions because they did not do the food shopping or 


preparation. Some SPs were confused by the terminology in the questionnaire. 


The interviewers did not encounter any problems when the SP used the reminder postcard 
listing the response categories. However, when the postcard was not available for reference, the 


interviewer had to repeat the answer categories frequently. 


The best candidates for in-person DHKS interviews were SPs who were hard of hearing, 
those who avoided the interview, very talkative SPs, elderly persons, SPs without telephones, those 


with short attention spans, and SPs who did not speak English fluently. 


Many interviewers felt that the 2- to 3-week time gap between the Day 2 Intake and the 
DHKS interview hindered the rapport between the interviewer and the household. Others said that the 
hiatus was a good break, especially in households with many SPs. 
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4.A General Edit Forms for Non-Intake 


Questionnaires 
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General Edit of Household Folder, Screener, and Household Questionnaire/NIRF 


Interviewer ID: 


Item Description 
[Check if problem. ] 


HHF recording attempts incomplete 

Screener Cover incomplete 
Q1 + Enumeration Table 
Enumeration incomplete/incorrect 
Q11 and Q12 (DOB and Age) inconsistent 
Screener R not identified 

Q's 14, 14a, 14b inappropriately skipped 
Q14 Hand Card number missing 
Q14 Wrong Hand Card 
Box 1 incorrect 
Box 3 incorrect 
SP selection incorrect 
Q's 20 & 21 inappropriately skipped 
Box 6 incorrect 
Box 8 incorrect 
Sp selection incorrect 

HHQ Cover incomplete 
Q's 10-16 person list incorrect 
Q's 10-16 names/line letter incorrect 
Q47 Hand Card number missing 
Q47 Wrong Hand Card 

NIRF inappropriately skipped 
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General Edit of DHKS Folder, DHKS Questionnaire/NIRF 


Interviewer ID: 


Week ending: 
Page 
0) 5) zs) Oo x) 
oe S S = 3 3 
Item Description = E E = = 
[Check if problem. ] = Ss = = = 
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4.B Individual Intake Reviewer/Coder Training 


Agenda 
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4.C Non-Intake Coder Training Agenda 


WHAT WE EAT IN AMERICA: 1994-1996 - MAIN SURVEY 


CODER TRAINING AGENDA 


SCREENER, HOUSEHOLD QUESTIONNAIRE, HOUSEHOLD FOLDER, 


Day 1 
Morning 
9:00 - 10:00 
10:00 - 10:15 

10:15 - 10:30 

10:30 - 11:00 


11:00 - 12:00 


12:00 - 1:00 


Afternoon 
1:00 - 2:00 
2:00 - 3:00 
3:00 - 3:30 
3:30 - 3:45 
3:45 - 4:00 


4:00 - 5:00 


AND NON-INTERVIEW REPORT FORM 


Thursday, February 10, 1994 


Introduction to Screener and Household Questionnaires 
Flow of Non-Intake Documents 

BREAK 
Manual 


Interactive Screener Exercise #1 


LUNCH 


Interactive Screener Exercise #1 -- continued 
Independent Screener Exercise #2 and Review 
Independent Screener Exercise #3 and Review 
BREAK 

Independent Screener Exercise #4 and Review 


Interactive Household Questionnaire Exercise #1 


(1) 


Day 2 Friday, February 11, 1994 


Morning 
9:00 - 10:30 
10:30 - 10:45 
10:45 - 11:15 
11:15 - 12:00 
12:00 - 1:00 

Afternoon 
1:00 - 2:00 
2:00 52:30 
2:30 - 3:00 
3:00 - 3:15 
3:15 - 3:45 
3:45 - 4:15 


Independent Household Questionnaire Exercise #2 and Review 
BREAK 
Introduction to Household Folder and Non-Interview Report Form 


Interactive Household Folder Exercise #1 


LUNCH 


Independent Household Folder Exercise #2 and Review 
Independent Household Folder Exercise #3 and Review 
Independent Household Folder Exercise #4 and Review 
BREAK 

Interactive Non-Interview Report Form Exercise #1 


Independent Non-Interview Report Form Exercise #2 and Review 


4.D Missing Detail Report 
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Interviewers with Missing Detail(s) 


Dielostriday, April) 28,1995 


Year 2 Data 


Percent of Number of 
foods with Obed Foods with 
tite Missing Number of Missing 
PSU ID Detail (s) Foods Detail (s) 
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4.E General Interviewer Error Report 
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4.F Survey Net Adjudication Report 
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4.G Survey Net Error Rate Calculation 


satteluols? ota to Tee 16 vorvme 


Attachment 4.G 
Survey Net Error Rate Calculation 


The two error rates calculated for Survey Net coders are the cover sheet error rate and the food 
data error rate. The calculations used for the error rates are shown below: 


if Cover sheet error rate = 100 X (number of cover sheet fields with errors + total number 
of cover sheet fields) 
Total number of cover sheet fields = 17 

De Food data error rate = 100 X (number of food fields with errors + number of food 
fields entered) 
Number of food fields entered = the number of foods entered X 17 

Cover sheet fields 

1. Household ID 

oe Subject ID 

3. Date of Intake 

4. Date of interview 

2: Day of week of interview 

6. First name of respondent 

hs Date of birth 

8. Age 

9. Sex 

10. Interviewer ID 

11. Time interview started -- day, month, year 

12. AM/PM 

13. Time interview ended -- day, month, year 

14. AM/PM 

15. Sample year 

16. Day lor2 

17. Coder ID 

Food fields 

ie Time 

2 AM/PM 

a What called 

4. Line number 

a3 Combination type 


oe 


Combination number 
Food code 


Modified food 

Modified food description 
Unknown food category 
Unknown food description 
How many 

Measure 

Unknown amount 
Unknown amount description 
What called other 

Where obtained other 
Where obtained 

Food eaten at home 

Food brought into the home 
Notepad 

Request review 

Salt 


“1% 


od 


Sie 


